ABSTRACT 


Title  of  dissertation:  FLOW  CONTROL  IN  WIRELESS 

AD-HOC  NETWORKS 

Georgios  Papageorgiou, 

Doctor  of  Philosophy,  2009 

Dissertation  directed  by:  Professor  John  S.  Baras, 

Department  of  Electrical  and 
Computer  Engineering 

We  are  interested  in  maximizing  the  Transmission  Control  Protocol  (TCP)  through¬ 
put  between  two  nodes  in  a  single  cell  wireless  ad-hoc  network.  For  this,  we  follow  a 
cross-layer  approach  by  first  developing  an  analytical  model  that  captures  the  effect  of 
the  wireless  channel  and  the  MAC  layer  to  TCP  The  analytical  model  gives  the  time  evo¬ 
lution  of  the  TCP  window  size  which  is  described  by  a  stochastic  differential  equation 
driven  by  a  point  process.  The  point  process  represents  the  arrival  of  acknowledgments 
sent  by  the  TCP  receiver  to  the  sender  as  part  of  the  self-regulating  mechanism  of  the 
flow  control  protocol.  Through  this  point  process  we  achieve  a  cross-layer  integration 
between  the  physical  layer,  the  MAC  layer  and  TCP.  The  intervals  between  successive 
points  describe  how  the  packet  drops  at  the  wireless  channel  and  the  delays  because  of  re¬ 
transmission  at  the  MAC  layer  affect  the  window  size  at  the  TCP  layer.  We  fully  describe 
the  statistical  behavior  of  the  point  process  by  computing  first  the  p.d.f.  for  the  inter¬ 
arrival  intervals  and  then  the  compensator  and  the  intensity  of  the  process  parametrized 
by  the  quantities  that  describe  the  MAC  layer  and  the  wireless  channel. 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

2QQ9  2.  REPORT  TYPE 

3.  DATES  COVERED 

00-00-2009  to  00-00-2009 

4.  TITLE  AND  SUBTITLE 

Flow  Control  in  Wireless  Ad-Hoc  Networks 

5a.  CONTRACT  NUMBER 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROJECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

University  of  Maryland,  College  Park, Department  of  Electrical  and 
Computer  Engineering, College  Park, MD, 20742 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 


14.  ABSTRACT 

We  are  interested  in  maximizing  the  Transmission  Control  Protocol  (TCP)  throughput  between  two  nodes 
in  a  single  cell  wireless  ad-hoc  network.  For  this,  we  follow  a  cross-layer  approach  by  first  developing  an 
analytical  model  that  captures  the  effect  of  the  wireless  channel  and  the  MAC  layer  to  TCP.  The  analytical 
model  gives  the  time  evolution  of  the  TCP  window  size  which  is  described  by  a  stochastic  differential 
equation  driven  by  a  point  process.  The  point  process  represents  the  arrival  of  acknowledgments  sent  by 
the  TCP  receiver  to  the  sender  as  part  of  the  self-regulating  mechanism  of  the  flow  control  protocol. 
Through  this  point  process  we  achieve  a  cross-layer  integration  between  the  physical  layer,  the  MAC  layer 
and  TCP.  The  intervals  between  successive  points  describe  how  the  packet  drops  at  the  wireless  channel 
and  the  delays  because  of  retransmission  at  the  MAC  layer  affect  the  window  size  at  the  TCP  layer.  We 
fully  describe  the  statistical  behavior  of  the  point  process  by  computing  first  the  p.d.f.  for  the  interarrival 
intervals  and  then  the  compensator  and  the  intensity  of  the  process  parametrized  by  the  quantities  that 
describe  the  MAC  layer  and  the  wireless  channel.  To  achieve  analytical  tractability  we  concentrate  on  the 
pure  (unslotted)  Aloha  for  the  MAC  layer  and  the  Gilbert-Elliott  model  for  the  channel.  Although  the 
Aloha  protocol  is  simpler  than  the  more  popular  IEEE  802.11  protocol,  it  still  exhibits  the  same 
exponential  backoff  mechanism  which  is  a  key  factor  for  the  performance  of  TCP  in  a  wireless  network. 
Moreover,  another  reason  to  study  the  Aloha  protocol  is  that  the  protocol  and  its  variants  gain  popularity 
as  they  are  used  in  many  of  today?s  wireless  networks.  Using  the  analytical  model  for  the  TCP  window  size 
evolution,  we  try  to  increase  the  TCP  throughput  between  two  nodes  in  a  single  cell  network.  We  want  to 
achieve  this  by  implicitly  informing  the  TCP  sender  of  the  network  conditions.  We  impose  this  additional 
constraint  so  we  can  achieve  compatibility  between  the  standard  TCP  and  the  optimized  version.  This 
allows  the  operation  of  both  protocol  stacks  in  the  same  network.  We  pose  the  optimization  problem  as  an 
optimal  stopping  problem.  For  each  packet  transmitted  by  the  TCP  sender  to  the  network,  an  optimal  time 
instance  has  to  be  computed  in  the  absence  of  an  acknowledgment  for  this  packet.  This  time  instance 
indicates  when  a  timeout  has  to  be  declared  for  the  packet.  In  the  absence  of  an  acknowledgment  if  the 
sender  waits  long  for  declaring  a  timeout,  the  network  is  underutilized.  If  the  sender  declares  a  timeout 
soon,  it  minimizes  the  transmission  rate.  Because  of  the  analytical  intractability  of  the  optimal  stopping 
time  problem,  we  follow  a  Markov  chain  approximation  method  to  solve  the  problem  numerically. 


15.  SUBJECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

Same  as 
Report  (SAR) 

18.  NUMBER 
OF  PAGES 

90 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


To  achieve  analytical  tractability  we  concentrate  on  the  pure  (unslotted)  Aloha  for 
the  MAC  layer  and  the  Gilbert-Elliott  model  for  the  channel.  Although  the  Aloha  protocol 
is  simpler  than  the  more  popular  IEEE  802.1 1  protocol,  it  still  exhibits  the  same  exponen¬ 
tial  backoff  mechanism  which  is  a  key  factor  for  the  performance  of  TCP  in  a  wireless 
network.  Moreover,  another  reason  to  study  the  Aloha  protocol  is  that  the  protocol  and 
its  variants  gain  popularity  as  they  are  used  in  many  of  today’s  wireless  networks. 

Using  the  analytical  model  for  the  TCP  window  size  evolution,  we  try  to  increase 
the  TCP  throughput  between  two  nodes  in  a  single  cell  network.  We  want  to  achieve 
this  by  implicitly  informing  the  TCP  sender  of  the  network  conditions.  We  impose  this 
additional  constraint  so  we  can  achieve  compatibility  between  the  standard  TCP  and  the 
optimized  version.  This  allows  the  operation  of  both  protocol  stacks  in  the  same  network. 

We  pose  the  optimization  problem  as  an  optimal  stopping  problem.  For  each  packet 
transmitted  by  the  TCP  sender  to  the  network,  an  optimal  time  instance  has  to  be  com¬ 
puted  in  the  absence  of  an  acknowledgment  for  this  packet.  This  time  instance  indicates 
when  a  timeout  has  to  be  declared  for  the  packet.  In  the  absence  of  an  acknowledg¬ 
ment,  if  the  sender  waits  long  for  declaring  a  timeout,  the  network  is  underutilized.  If 
the  sender  declares  a  timeout  soon,  it  minimizes  the  transmission  rate.  Because  of  the 
analytical  intractability  of  the  optimal  stopping  time  problem,  we  follow  a  Markov  chain 
approximation  method  to  solve  the  problem  numerically. 


FLOW  CONTROL  IN  WIRELESS  AD-HOC  NETWORKS 


by 

Georgios  Papageorgiou 


Dissertation  submitted  to  the  Faculty  of  the  Graduate  School  of  the 
University  of  Maryland,  College  Park  in  partial  fulfillment 
of  the  requirements  for  the  degree  of 
Doctor  of  Philosophy 
2009 


Advisory  Committee: 

Professor  John  S.  Baras,  Chair/ Advisor 
Professor  Armand  M.  Makowski 
Professor  Sennur  Ulukus 
Professor  Nuno  C.  Martins 

Professor  A.  Udaya  Shankar,  Dean’s  Representative 


©  Copyright  by 
Georgios  Papageorgiou 
2009 


DEDICATION 


To  my  late  father  Aristides,  my  mother  Antonia  and 
my  sister  Efrosyni. 


n 


ACKNOWLEDGMENTS 


I  am  grateful  to  my  advisor,  Prof.  John  S.  Baras,  for  his  continuous  support  and 
encouragement  during  the  entire  period  of  my  graduate  studies  at  the  University  of  Mary¬ 
land.  His  patience  and  generosity,  even  during  tough  times,  were  limitless.  His  energy, 
enthusiasm,  persistence,  deep  mathematical  insight  and  expertise  in  different  and  varying 
topics  have  always  been  a  constant  source  of  motivation  for  me.  The  fact  that  he  fosters  a 
research  environment  free  of  constraints,  where  a  student  is  encouraged  to  explore  differ¬ 
ent  research  areas  and  problems,  allowed  me  to  work  on  various  problems  that  may  not 
be  part  of  this  thesis,  but  introduced  me  to  various  mathematical  tools  and  methodologies. 
This  involvement  helped  me  to  build  a  concrete  mathematical  background  and  increased 
research  maturity. 

I  am  also  grateful  to  my  thesis  committee  members,  Prof.  Armand  M.  Makowski, 
Prof.  Sennur  Ulukus,  Prof.  Nuno  C.  Martins  and  Prof.  A.  Udaya  Shankar,  for  agreeing 
to  serve  on  my  committee.  Prof.  Makowski  and  Prof.  Ulukus  provided  me  with  useful 
feedback  during  my  Thesis  Proposal  Examination. 

During  my  graduate  studies  at  the  University  of  Maryland  I  had  the  privilege  to 
take  classes  with  some  exceptional  teachers.  I  would  like  to  take  this  opportunity  and 
thank  Profs.  Gilmer  L.  Blankenship,  P.  S.  Krishnaprasad,  Steve  Markus  (control  theory, 
optimization),  Adrian  Papamarcou,  Armand  M.  Makowski,  Mark  I.  Freidlin  (probability 
theory,  stochastic  processes  and  information  theory).  Their  dedication  to  teaching  and  the 

iii 


extra  effort  they  always  made  to  organize  and  present  the  course  material  in  an  interesting 
manner  made  the  task  of  learning  more  enjoyable.  Having  had  a  background  in  Computer 
Science,  I  could  not  have  wished  for  better  teachers  to  take  upon  themselves  the  task  of 
introducing  me  to  a  whole  new  and  exciting  world  of  science.  Their  deep  knowledge, 
experience,  intuition,  relaxed  style  and  graciousness  towards  their  students  had  a  profound 
impact. 

The  life  of  a  graduate  student  involves  dealing  with  bureaucratic  issues  from  time 
to  time.  I  would  like  to  thank  Kim  Edwards,  Althia  Kirlew  and  Diane  Hicks  for  their 
efficiency  in  keeping  all  these  administrative  details  to  an  absolute  minimum.  I  would 
also  like  to  thank  the  staff  of  both  ECE  and  ISR  for  always  trying  to  do  their  best  helping 
students  with  official  matters. 

I  would  also  like  to  thank  a  number  of  colleagues  that  made  the  long  hours  in  the  of¬ 
fice  or  the  lab  to  seem  not  so  bad  after  all:  Pedram  Hovareshti,  Punyaslok  Purkayastha,  Ion 
Matei,  Vahid  Tabatabaee,  Kiran  Kumar  Somasundaram,  Kaustubh  Jain,  Vladimir  Ivanov, 
Tao  Jiang,  and  Ayan  Roy-Chowdhury.  I  also  feel  very  fortunate  to  have  made  some 
good  friends  here  at  Maryland  whose  support  and  help  I  could  always  count  on,  includ¬ 
ing  Senni  Perumal,  Vasilis  Botopoulos,  Konstantinos  Bitsakos,  Nikolaos  Frangiadakis, 
Maben  Rabi,  Yadong  Shang,  Nick  Pavlounis  and  Christine  Demkowych. 

Most  and  above  all  I  would  like  to  thank  my  family  for  their  never-ending  support 
and  unconditional  love. 

This  work  was  supported  by  the  National  Aeronautics  and  Space  Administration 
under  Cooperative  Agreements  No.  NCC8-235  and  NAG3-2844,  by  Communications 
and  Networks  Consortium  sponsored  by  the  U.S.  Army  Research  Laboratory  under  the 


Collaborative  Technology  Alliance  Program  Cooperative  Agreement  DAAD 19-0 1-2-001, 
and  by  the  DARPA  NMS  Project  under  the  Collaborative  Agreement  N6600100C8063. 


v 


Table  of  Contents 


List  of  Tables  viii 

List  of  Figures  ix 

1  Introduction  1 

1.1  Motivation .  1 

1.2  Problems  Addressed  and  Approach .  3 

1.3  Contributions  of  the  Thesis .  6 

2  Cross-layer  Integration  between  TCP  and  Aloha  8 

2.1  Introduction .  8 

2.2  Model  Description  .  14 

2.3  Analysis .  17 

2.3.1  Physical  Layer .  18 

2.3.2  MAC  Layer .  19 

2.3.3  Transport  Layer .  25 

2.3.3. 1  Underlying  Point  Processes .  25 

2. 3. 3. 2  The  Slow-Start  Threshold  Process  H  =  (Ht)t>o  •  •  •  •  27 

2. 3. 3. 3  The  Window  Size  Process  W  =  (Wt)t>0 .  28 

2.4  Validation  of  the  Model .  30 

3  Optimal  Timeout  Mechanism  of  TCP  over  Aloha  34 

3.1  Introduction .  34 

3.2  Problem  Formulation .  37 

3.3  Hamilton-Jacobi-Bellman  (HJB)  Equation .  40 

3.4  Preliminary  Analysis  for  the  Numerical  Approximation .  43 

3.4.1  Jump  Process .  43 

3.5  Numerical  Approximation .  46 

3.5.1  Markov  Chain  Approximation .  47 

3.5.2  Transition  Probabilities .  50 

3.5.2. 1  Computation  of  the  Transition  Probability  pj .  53 

3.5.3  Running  and  Final  Rewards .  55 

3.5.4  Optimal  Stopping  and  Dynamic  Programming  .  57 

3.5.5  Simulation  Results .  58 

4  Conclusions  65 

4. 1  TCP  and  Aloha .  65 

4.2  Timeout  Mechanism  .  66 

A  Appendix  to  Chapter  2  68 

A.  1  Physical  Layer  .  68 

A. 2  MAC  Layer .  70 

A. 3  Negative  Binomial  Distribution .  71 


vi 


A.  4  Thinning .  71 

B  Appendix  to  Chapter  3  73 

B. l  Computation  of  E  73 

Bibliography  74 


vii 


List  of  Tables 


3 . 1  Simulation  parameters 


58 


List  of  Figures 


2.1  The  Gilbert-Elliott  model .  15 

2.2  System  model .  17 

2.3  Window  size  evolution  in  the  absence  of  channel  losses  (22  nodes) .  31 

2.4  Window  size  evolution  in  the  absence  of  channel  losses  (42  nodes) .  32 

2.5  Window  size  evolution  with  channel  losses  (22  nodes) .  33 

2.6  Window  size  evolution  in  the  absence  of  channel  losses  (44  nodes) .  33 

3.1  The  Markov  chain  approximation  for  the  Optimal  Stopping  problem.  ...  50 

3.2  The  Markov  chain  approximation  for  the  Optimal  Stopping  problem  with 

different  state  representation .  51 

3.3  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and 

the  TCP  mechanism  in  the  absence  of  losses  at  the  channel  and  mean 
retransmission  waiting  time  O.lsec  at  the  MAC  layer. .  60 

3.4  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and 

the  TCP  mechanism  in  the  absence  of  losses  at  the  channel  and  mean 
retransmission  waiting  time  0.01  sec  at  the  MAC  layer.  .  61 

3.5  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and 

the  TCP  mechanism  with  a  loss  prob.  0.5  at  the  channel  and  mean  re¬ 
transmission  waiting  time  O.lsec  at  the  MAC  layer.  .  62 

3.6  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and 

the  TCP  mechanism  with  a  loss  prob.  0.5  at  the  channel  and  mean  re¬ 
transmission  waiting  time  0.01  sec  at  the  MAC  layer.  .  63 

3.7  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and 
the  TCP  mechanism  with  a  loss  prob.  0.3  at  the  channel,  mean  retransmis¬ 
sion  waiting  time  O.Olsec  at  the  MAC  layer  and  discount  factor  f3  =  0.001.  64 


Chapter  1 


Introduction 

This  chapter  serves  as  an  introduction  to  the  rest  of  the  thesis,  by  providing  the 
motivation  for  the  current  work.  Moreover,  it  introduces  the  problems  that  are  addressed 
and  the  approach  and  tools  used  to  solve  these  problems. 

1.1  Motivation 

Wireless  ad-hoc  networks  had  been  used  until  recently  in  military  applications  and 
also  in  emergency  situations  where  the  nature  of  the  situation  does  not  allow  the  deploy¬ 
ment  and  usage  of  a  communication  infrastructure,  e.g.  physical  destruction,  etc.  In 
the  recent  years  however,  wireless  ad-hoc  networks  have  become  quite  popular  and  are 
widely  used  for  commercial  applications.  New  standards  have  been  introduced  (IEEE 
802.11,  Bluetooth,  etc.)  that  helped  to  increase  the  popularity  of  Wireless  Local  Area 
Networks  (WLAN’s),  which  is  one  class  of  ad-hoc  networks.  Presently,  there  is  also  an 
increasing  interest  for  sensor  networks,  not  only  for  military  purposes  but  also  for  com¬ 
mercial  use. 

Key  features  of  wireless  ad-hoc  networks  include  the  lack  of  infrastructure,  the  need 
to  operate  under  energy  constraints,  the  fact  that  each  node  in  the  network  operates  both 
as  a  host  and  as  a  router  (i.e.  a  node  is  responsible  to  relay  information  not  destined  to 
it  to  other  nodes  in  the  network),  mobility  and  the  physical  characteristics  of  the  wireless 
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channel.  Such  features  yield  the  design  and  implementation  of  a  wireless  ad-hoc  network, 
a  non  trivial  task.  The  study  of  ad-hoc  networks  has  also  unveiled  the  need  to  diverge 
from  the  paradigm  of  layering.  Since  the  early  days  of  packet  networking,  the  designers 
of  such  networks  have  been  following  a  “divide-and-conquer”  approach  in  defining  and 
implementing  the  various  functions  necessary  for  the  operation  of  the  network.  Related 
operations  are  grouped  together  forming  a  layer  and  each  layer  is  treated  as  a  black  box 
with  a  very  well  and  formally-defined  interface.  Although  this  approach  makes  the  control 
and  maintenance  of  networks  easier,  it  fails  to  reveal  the  dependencies  among  quantities 
that  exist  in  different  layers,  thus  causing  suboptimal  performance. 

In  a  wireless  ad-hoc  network  it  makes  sense  to  consider  a  cross-layer  (i.e.  vertical 
across  the  protocol  stack)  integration,  especially  among  the  lower  layers  of  the  protocol 
stack:  physical,  Medium  Access  Control  (MAC),  network,  transport,  since  these  are  the 
layers  that  participate  the  most  during  a  packet  exchange  both  from  a  hop-by-hop  and  an 
end-to-end  point  of  view.  Nevertheless,  inter-dependencies  can  be  found  even  between 
the  upper  and  lower  layers,  e.g.  depending  on  the  specific  characteristics  of  the  wireless 
channel  (physical  layer)  different  source  coding  (application  layer)  and  channel  coding 
(link  layer)  schemes  can  be  used  to  adapt  to  available  bandwidth,  fading,  latency,  etc. 
Another  example  where  the  dependency  of  one  layer  to  another  is  evident  is  related  to 
power  control.  Traditionally,  power  control  was  treated  as  a  physical  layer  characteristic. 
Most  of  the  schemes  that  were  developed  in  the  context  of  power  control  aimed  to  adjust 
the  transmitting  power  of  a  node  in  order  to  maximize  the  signal  to  noise  and  interference 
ratio  subject  to  the  channel  characteristics  (fading,  interference,  noise).  In  a  wireless  ad- 
hoc  network  however,  the  power  level  at  which  a  node  is  transmitting  defines  not  only  the 
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interference  this  node  is  creating  to  other  nodes  but  also  what  nodes  in  the  network  are 
immediately  accessible  (one-hop  away).  Thus,  power  control  determines  the  connectivity 
of  the  wireless  ad-hoc  network  and  in  consequence  it  affects  how  packets  are  routed  in 
the  network  (network  layer). 

An  example  which  is  more  relevant  to  the  current  work  and  makes  the  need  for 
layer  coupling  even  more  obvious  is  the  operation  of  the  Transmission  Control  Protocol 
(TCP)  over  a  wireless  network.  The  main  functionality  of  TCP  is  to  control  the  rate  of 
information  sent  from  a  host  node  to  the  network.  At  the  same  time  TCP  controls  the 
number  of  outstanding  packets,  i.e.  packets  whose  receipt  has  not  been  acknowledged 
by  the  destination.  This  is  done  by  using  a  window  based  mechanism.  In  the  event 
of  a  packet  loss,  TCP  assumes  congestion  exists  in  the  network  and  abruptly  reduces  its 
window  size.  Although  such  an  assumption  is  reasonable  in  the  case  of  the  Internet  where 
most  of  the  packet  losses  are  due  to  buffer  overflow,  it  is  not  always  true  for  a  wireless 
environment.  On  wireless  links  a  packet  may  be  lost  because  of  errors  at  the  channel.  A 
simple  reaction  in  this  case  would  had  been  the  retransmission  of  the  lost  packet.  But  TCP 
cannot  distinguish  between  the  two  cases  and  reacts  to  the  packet  loss  because  of  errors 
on  the  channel  as  if  it  were  caused  by  congestion.  This  results  to  the  under-utilization  of 
the  channel  since  the  end  host  is  forced  to  send  packets  in  the  network  with  a  lower  rate. 

1.2  Problems  Addressed  and  Approach 

The  problem  that  is  explored  in  this  thesis  is  that  of  maximizing  the  TCP  throughput 
for  a  connection  between  two  nodes  in  a  wireless  ad-hoc  network.  It  is  known  that  TCP 
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is  impaired  by  performance  degradation  in  a  wireless  network  and  the  main  reason  for 
this  is  the  inherent  assumption  that  a  packet  loss  is  due  to  congestion  in  the  network.  In  a 
wireless  network  however,  it  is  possible  that  packets  are  dropped  because  of  bad  channel 
quality  (e.g.  fading).  In  such  a  case,  the  reaction  of  TCP,  which  is  to  reduce  the  sending 
rate  of  data,  does  not  solve  the  problem  it  only  makes  things  worse. 

Instead  of  explicitly  informing  the  TCP  sender  of  the  nature  of  a  packet  loss,  our 
approach  to  the  problem  is  to  inform  the  sender  implicitly.  We  impose  this  constraint  be¬ 
cause  we  want  to  keep  any  changes  to  the  TCP  protocol  stack  to  a  minimum.  By  keeping 
protocol  changes  small  and  only  local  to  the  TCP  sender,  we  can  achieve  compatibility 
between  the  TCP  protocol  stack  optimized  for  a  wireless  node  and  the  standard  TCP  pro¬ 
tocol  stack  operating  on  a  host  in  the  Internet.  This  can  lead  to  an  easier  adoption  of  the 
new  scheme. 

In  our  approach,  the  implicit  notification  the  TCP  sender  receives  regarding  the 
condition  of  the  network  and  the  possible  cause  of  a  packet  drop  is  achieved  through 
the  feedback  mechanism  of  acknowledgments  (or  the  lack  of  them).  In  more  detail,  we 
assume  the  TCP  sender  and  receiver  are  one  hop  away  and  thus  there  can  be  no  congestion 
in  intermediate  queues.  In  addition,  we  assume  the  MAC  mechanism  is  that  of  unslotted 
Aloha.  The  choice  of  unslotted  Aloha  allows  for  tractability  in  the  analysis,  since  our 
focus  is  on  the  dynamics  of  the  system,  rather  than  the  average  behavior.  Moreover,  Aloha 
captures  the  behavior  of  the  backoff  machinery  that  is  present  in  more  popular  wireless 
networks  such  as  IEEE  802.1 1  systems.  Finally,  we  model  the  effects  of  the  physical  layer 
using  a  two-state  Markov  chain  where  a  packet  is  lost  or  not  with  probability  1  depending 
on  the  state  of  this  chain. 
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Using  this  model  and  results  from  [17,34],  we  are  able  to  describe  the  TCP  window 
size  evolution  using  a  stochastic  differential  equation  driven  by  a  point  process.  The 
driving  point  process  describes  the  arrival  of  acknowledgments  to  the  TCP  sender  and  its 
intensity  is  given  as  a  function  of  the  parameters  that  describe  the  unslotted  Aloha  and 
the  Markov  chain  for  the  physical  layer.  Thus,  a  cross-layer  (i.e.  vertical  across  layers) 
integration  is  achieved  through  the  protocol  stack  on  the  wireless  node. 

Using  the  stochastic  differential  equation  that  describes  the  evolution  of  the  win¬ 
dow  size,  we  try  to  pose  an  optimization  problem.  The  objective  is  to  maximize  the  TCP 
throughput  with  constraints  that  come  from  the  stochastic  differential  equation.  The  prob¬ 
lem  can  be  posed  as  an  optimal  stopping  problem  where  the  TCP  sender  needs  to  choose 
the  optimal  time  to  declare  a  timeout  event  in  the  absence  of  a  received  acknowledgment 
for  a  packet  that  has  been  sent  to  the  network.  This  is  because  at  any  point  in  time,  the 
TCP  sender  can  either  continue  waiting  to  receive  an  acknowledgment  or  since  an  ac¬ 
knowledgment  has  not  been  received,  declare  a  timeout  and  retransmit  the  packet.  The 
first  choice  incurs  delays  and  leaves  the  connection  idle  and  thus  decreases  the  throughput. 
In  the  event  of  a  received  acknowledgment,  the  TCP  sender  can  resume  operation  from 
the  stopping  point  without  having  to  minimize  its  window  size  and  begin  from  slow-start 
again.  The  second  choice  minimizes  the  time  the  connection  is  kept  idle,  at  the  expense 
of  using  the  connection  with  a  small  sending  rate,  since  a  timeout  event  is  declared  and 
the  TCP  sender  has  to  switch  to  the  slow-start  mode  of  operation  minimizing  at  the  same 
time  its  window  size. 

Because  of  analytical  intractability  for  this  optimal  stopping  problem,  and  moti¬ 
vated  by  the  approximation  method  of  Kushner  [28-31]  we  choose  to  approximate  the 
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original  problem  with  a  discrete  time  version,  by  appropriately  defining  a  Markov  chain 
and  solving  a  dynamic  programming  problem  on  that  Markov  chain. 

1.3  Contributions  of  the  Thesis 

Because  of  its  importance  and  popularity,  TCP  has  been  analyzed  frequently  under 
different  assumptions  and  for  different  communication  environments  (i.e.  Internet,  wire¬ 
less,  satellite  networks)  and  the  related  literature  is  extensive  (see  for  example  [3,4,9-12, 
18-20, 23, 26, 27, 32, 33, 37, 39, 44-47, 55] . 

The  vast  majority  of  the  literature,  concentrates  on  the  average  behavior  of  TCP, 
generally  ignoring  in  most  of  the  cases  the  dynamic  evolution  of  quantities  such  as  the 
window  size.  Even  when  the  dynamics  of  TCP  are  studied,  the  round-trip  time  of  pack¬ 
ets  are  typically  constant  and  are  not  associated  with  the  layers  below  TCP  such  as  the 
physical  layer,  the  MAC  or  the  routing.  In  Chapter  2  of  this  thesis  we  develop  a  sim¬ 
ple  stochastic  differential  equation  that  describes  the  evolution  of  the  window  size.  The 
equation  is  driven  by  a  point  process  that  represents  the  sequence  of  acknowledgments 
arriving  to  the  TCP  sender.  The  statistical  properties  of  this  point  process  are  described 
in  terms  of  quantities  that  relate  to  the  MAC  layer  and  the  channel. 

Previous  work  on  the  analysis  of  TCP  concentrates  on  the  congestion  avoidance 
part  of  the  protocol  ignoring  the  slow-start  phase.  Typically,  this  is  justified  by  the  fact 
that  in  the  Internet,  most  of  the  packet  losses  happen  because  of  buffer  overflow  and 
these  losses  are  detected  at  the  TCP  sender  by  the  duplicate  acknowledgment  mechanism. 
When  this  happens,  the  TCP  sender  starts  operating  in  the  congestion  avoidance  phase. 


6 


But,  if  TCP  operates  over  a  wireless  network,  packet  losses  may  also  occur  due  to  poor 
channel  quality.  If  a  burst  of  packets  is  lost  the  duplicate  acknowledgment  mechanism 
does  not  work  and  thus  a  timeout  is  declared.  In  such  a  case  the  sender  switches  to  the 
slow-start  phase.  Thus,  it  is  important  to  analyze  the  timeout  mechanism  of  TCP  and  try 
to  associate  its  performance  with  the  underlying  wireless  medium. 

Building  on  the  work  of  Chapter  2  we  develop  a  framework  that  allows  the  designer 
of  a  wireless  network  to  properly  tune  and  optimize  the  timeout  mechanism  of  TCP  in 
order  to  increase  the  throughput  of  the  network.  This  approach  is  presented  in  Chapter  3 
of  the  thesis. 
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Chapter  2 


Cross-layer  Integration  between  TCP  and  Aloha 

In  this  chapter  the  interaction  between  the  Additive-Increase,  Multiplicative-Decrease 
(AIMD)  algorithm  of  the  Transmission  Control  Protocol  (TCP)  and  the  random  access 
channel  is  investigated.  In  particular,  we  examine  the  effect  of  the  Medium  Access  Con¬ 
trol  (MAC)  and  the  physical  layer  on  the  window  size  evolution  of  TCP  The  problem  of 
coupling  the  window  size  evolution  of  TCP  with  a  random  access  channel  is  addressed 
using  point  processes. 

2. 1  Introduction 

TCP  is  very  popular  in  wired  networks  and  is  also  used  in  the  first  generation  of 
many  wireless  networks.  Thus,  it  is  important  to  investigate  its  performance  over  a  wire¬ 
less  communication  environment.  In  a  wireless  environment  the  characteristics  of  com¬ 
munication  are  quite  different  compared  to  those  of  a  wired  environment,  yielding  the 
existing  layering  approach  of  protocols  inefficient.  It  is  believed  that  a  closer  intercon¬ 
nection  between  various  layers  in  the  protocol  stack  of  a  mobile  node  would  allow  for 
a  better  utilization  of  the  wireless  network.  One  aspect  of  this  cross-layer  integration 
should  include  the  flow-control,  which  is  an  end-to-end  function,  and  access  control  of 
the  shared  wireless  channel,  an  operation  which  is  local  to  each  mobile  node.  The  in¬ 
tegration  of  flow-control  with  Medium  Access  Control  would  prevent  a  data  source  in  a 
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mobile  node  from  overloading  the  network  and  hence,  decrease  its  overall  performance. 

In  this  chapter,  we  consider  the  window-based  mechanism  of  flow-control  of  TCP 
on  top  of  an  Aloha-based  MAC  protocol.  All  nodes  in  the  network  are  in  hearing  distance 
from  each  other,  thus  the  hidden  terminal  problem  does  not  exist.  The  characteristics 
of  the  physical  channel  are  captured  through  the  use  of  a  simple  two-state  Markov  pro¬ 
cess.  Aloha  is  chosen  as  the  MAC  protocol  since  it  provides  a  very  simple  channel  access 
mechanism  and  also  because  it  captures  in  a  simple  way  the  random  waiting  time  before 
retransmission  present  in  many  other  random  access  protocols.  Moreover,  various  forms 
of  the  Aloha  protocol  are  in  use  today  in  most  of  the  current  digital  cellular  networks, 
increasing  the  interest  for  this  protocol  [5-8,  35,  38].  In  this  chapter  we  attempt  to  de¬ 
velop  a  simple,  yet  complete  TCP  model  for  a  wireless  communications  environment  that 
captures  the  behavior  of  TCP  in  such  an  environment.  To  this  end,  we  consider  a  single 
persistent  TCP  connection  over  one  wireless  hop,  i.e.  the  TCP  sender  and  the  TCP  re¬ 
ceiver  are  one  hop  away.  Because  of  this,  no  buffering  is  performed  in  any  intermediate 
node,  and  thus,  the  round-trip  time  (RTT)  consists  mainly  of  the  delay  incurred  by  the 
MAC  in  its  effort  to  successfully  transmit  the  packet.  Since  we  are  interested  in  exam¬ 
ining  the  effect  of  timeouts  due  to  MAC  and  the  physical  layer,  we  assume  the  forward 
channel  (i.e.  the  channel  from  the  TCP  sender  to  the  receiver)  to  be  ideal,  in  the  sense 
that  there  are  no  packet  losses.  Thus,  there  are  no  duplicate  acknowledgments  (ACKs) 
received  at  the  TCP  sender.  The  same  situation,  i.e.  detection  of  packet  losses  through 
timeouts  rather  than  duplicate  acknowledgments,  arises  in  the  case  where  the  bandwidth- 
delay  product  is  small  [4].  Timeout  events  are  produced  because  of  ACK  losses  in  the 
backward  channel  (from  the  TCP  receiver  to  the  TCP  sender).  In  the  backward  channel 
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the  MAC  layer  introduces  delays  and  thus  increases  the  RTTs,  while  the  physical  layer  is 
responsible  for  ACK  losses. 

Due  to  the  great  importance  of  TCP  in  the  Internet,  various  models  of  it  have  been 
developed.  These  models  try  to  capture  the  operation  of  the  main  mechanisms  of  TCP 
and  to  give  insights  on  how  these  mechanisms  can  be  improved  in  order  to  fine-tune  TCP 
under  various  networking  environments. 

Low,  Paganini  and  Doyle  [36]  study  TCP  from  a  control  theory  point  of  view  in  the 
case  of  the  Internet.  They  interpret  TCP  as  an  optimal  controller  optimizing  specific  utility 
functions  at  equilibrium  and  also  look  at  the  dynamics  of  TCP  employing  linear  models  to 
exhibit  stability  limitations.  Their  analytical  model  incorporates  general  dynamic  models 
for  rate  control  at  the  source  and  for  pricing  at  each  link.  The  main  assumption  is  that 
each  source  has  access  to  the  aggregate  price  (i.e.  congestion  indication)  of  all  links  in 
its  route.  Under  the  assumption  of  constant  round-trip  time  and  not  considering  at  all  the 
slow-start  phase  of  TCP  or  timeouts,  they  are  able  to  provide  the  utility  functions  that 
TCP-Reno  and  TCP- Vegas  are  implicitly  using.  Although  this  was  one  of  the  first  works 
to  show  that  TCP  is  maximizing  certain  utility  functions,  its  applicability  to  the  wireless 
ad-hoc  networks  is  questionable.  The  main  reason  for  this  is  the  absence  of  the  notion  of 
links  in  such  networks,  and  thus  the  interpretation  of  them  as  price  producers. 

In  [40]  Mascolo  et  al.  propose  sender-side  modifications  to  TCP  to  improve  the 
throughput  especially  over  wireless  links.  They  call  the  new  flavor  TCP  Westwood 
(TCPW).  The  key  point  in  their  work  is  the  introduction  of  bandwidth  estimation  at  the 
sender  and  appropriate  adjustments  for  the  window  size  and  the  slow-start  threshold  after 
a  packet  loss  is  detected,  either  by  a  duplicate  acknowledgment  or  a  timeout.  They  aim 
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for  end-to-end  extensions  of  TCP  rather  than  “localized”  solutions  where  packet  inspec¬ 
tion  and/or  interception  is  required  at  specific  points  in  the  network  (e.g.  base  stations). 
An  issue  not  addressed  in  [40]  but  investigated  in  the  current  work,  relates  to  cases  where 
the  bottleneck  link  is  in  the  reverse  direction  from  the  receiver  to  the  sender.  In  such 
cases,  the  bottleneck  link  needs  to  be  shared  in  a  fair  manner  between  data  packets  and 
acknowledgment  packets. 

Bansal  et  al.  [11]  study  the  performance  of  TCP  in  a  multi-hop,  wireless  network 
such  that  of  IEEE  802.11.  They  focus  simultaneously  on  two  performance  metrics:  en¬ 
ergy  efficiency  and  TCP  session  throughput.  The  motivation  to  explore  these  two  metrics 
comes  from  the  fact  that  they  are  both  important  to  the  operation  of  a  wireless  network  but 
also  that  behave  differently  with  respect  to  the  transmission  range,  and  hence  the  number 
of  hops  traversed  in  a  communication  path.  A  short  transmission  range  increases  the  num¬ 
ber  of  hops  in  a  communication  path,  but  at  the  same  time  decreases  the  overall  energy 
consumption  for  the  end-to-end  communication.  Thus,  minimal  energy  consumption  fa¬ 
vors  a  short  transmission  range.  On  the  other  hand,  it  is  well  known  [41,47]  that  the  TCP 
throughput  of  a  session  is  inversely  proportional  to  the  round-trip  time  (i.e.  the  number 
of  hops  traversed  by  the  TCP  session)  and  the  square  root  of  the  packet  loss  rate.  This 
means  that  a  trade  off  needs  to  take  place  in  order  to  achieve  good  performance  for  both 
these  metrics.  In  [11]  it  is  shown  that  a  smaller  transmission  range  is  beneficial  from  an 
energy  perspective  up  to  a  point,  but  it  comes  with  a  cost  associated  with  the  TCP  session 
goodput. 

Abouzeid,  Roy  and  Azizoglou  [1]  also  investigate  the  performance  of  TCP  over 
a  wireless  link.  In  their  work  phenomena  relevant  to  fading  are  considered  as  well  as 
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queuing.  More  specifically,  they  consider  a  TCP  connection  where  one  end  is  a  server  in 
the  wired  network  and  the  other  end  resides  on  a  wireless  node.  The  communication  path 
includes  one  wireless  hop  and  a  series  of  wired  links.  In  their  analysis  they  consider  a  two- 
state  continuous  time  Markov  chain  that  models  the  wireless  link  behavior  and  provides 
for  the  packet  losses  because  of  fading  on  the  channel.  Along  with  packet  losses  because 
of  the  wireless  link,  they  include  in  their  analysis  packet  losses  associated  with  queuing. 
Another  novelty  of  their  work  is  the  consideration  of  variable  round-trip  times  and  of 
timeouts,  an  issue  which  is  almost  always  neglected  in  similar  studies  of  TCP.  On  the  other 
hand,  they  do  not  include  the  effect  of  the  MAC  layer  to  the  performance  of  TCP.  Their 
observations  include  the  fact  that  timeouts  (that  are  frequent  in  a  wireless  communication 
environment)  may  cause  underutilization  of  TCP  for  periods  of  time  much  longer  than  the 
time  the  channel  is  in  a  “bad”  state  because  of  fading.  They  suggest  that  a  modification 
to  the  exponential  backoff  algorithm  and  sampling  the  channel  can  improve  performance, 
but  they  do  not  provide  any  guidelines  to  this  direction.  Based  on  their  model,  they  point 
out  that  it  is  always  recommended  to  use  a  higher  packet  size  for  a  given  fading  rate, 
unlike  what  some  earlier  work  has  suggested. 

An  extensive  amount  of  work  has  also  been  performed  regarding  the  analysis  and 
modeling  of  MAC  and  especially  IEEE  802.11.  In  his  seminal  work  Bianchi  [16]  consid¬ 
ers  saturated  users  with  ideal  (no  channel  losses)  and  homogeneous  (equal  physical  data 
rate)  channel  conditions  with  no  hidden  terminals.  He  develops  a  model  for  the  analysis 
of  the  DCF  scheme  in  both  basic  packet  transmission  and  RTS/CTS  transmission  mech¬ 
anisms.  Using  this  model  he  provides  a  throughput  performance  evaluation  of  the  DCF 
scheme.  In  [52],  Sharma  et  al.  consider  the  same  problem  but  they  use  a  more  general 
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approach.  They  compute  again  the  throughput  of  the  network  and  provide  a  justification 
for  the  assumptions  used  in  [16]. 

Tobagi  et  al.  [25,43]  develop  a  model  where  blocking  and  interference  are  taken 
into  account.  In  [43]  they  compute  throughput  of  one  hop  connections  and  every  node 
can  transmit  to  a  single  node.  In  [25]  the  model  is  extended  for  the  case  of  one  single  path 
in  the  network  and  is  explained  that  the  same  methodology  can  by  used  to  model  multiple 
paths  as  long  as  there  is  no  common  node  between  the  paths. 

In  [13, 14],  Baras  et  al.,  develop  and  evaluate  a  new  method  for  estimating  and  opti¬ 
mizing  various  performance  metrics  for  multi-hop  wireless  networks,  including  MANETs. 
They  introduce  an  approximate  (throughput)  loss  model  that  couples  the  physical,  MAC 
and  routing  layers  effects.  The  model  provides  quantitative  statistical  relations  between 
the  loss  parameters  that  are  used  to  characterize  multiuser  interference  and  physical  path 
conditions  on  the  one  hand  and  the  traffic  rates  between  origin-destination  pairs  on  the 
other.  The  model  takes  into  account  effects  of  the  hidden  nodes,  scheduling  algorithms, 
IEEE  802.1 1  MAC  and  PHY  layer  transmission  failures  and  finite  packet  transmission  re¬ 
tries  at  the  MAC  layer  in  arbitrary  network  topologies  where  multiple  paths  share  nodes. 
They  apply  Automatic  Differentiation  (AD)  to  these  implicit  performance  models,  and 
develop  a  methodology  for  sensitivity  analysis,  parameter  optimization  and  trade-off  anal¬ 
ysis  for  key  wireless  protocols. 

In  [18, 19],  Bruno  et  al.  consider  the  interplay  between  the  TCP  dynamics  and  the 
IEEE  802.11  access  method.  They  present  a  simple  closed-form  expression  of  the  per- 
connection  TCP  throughput  as  a  function  of  the  average  duration  of  collisions,  the  average 
backoff  period  and  the  TCP  packet  size. 
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The  research  efforts  mentioned  above  compute  averages  for  the  various  quantities  of 
interest.  Our  approach  differs  from  them  in  that  we  try  to  directly  analyze  and  model  the 
dynamics  of  TCP  and  more  specifically  the  window  size  evolution  parametrized  by  quan¬ 
tities  relevant  to  the  MAC  layer  and  the  wireless  channel.  Because  of  the  complexities 
of  IEEE  802.11  considering  for  the  MAC  layer  yield  the  analysis  intractable.  Instead,  we 
choose  to  consider  the  Aloha  protocol  which  provides  for  a  more  tractable  MAC  model 
but  which  at  the  same  time  exhibits  the  exponential  backoff  periods  that  is  also  part  of 
IEEE  802.11. 

2.2  Model  Description 

The  flow-control  mechanism  of  TCP  is  modeled  according  to  the  AIMD  paradigm. 
Two  quantities  are  defined,  the  TCP  window  size  W  and  the  slow-start  threshold  S.  The 
window  size  W  in  the  sender  changes  dynamically  based  on  the  reception  of  acknowledg¬ 
ments  (ACKs).  During  normal  operation  of  the  protocol,  where  no  packet  losses  occur, 
the  arrival  of  an  acknowledgment  causes  the  increase  of  the  window  size.  An  acknowledg¬ 
ment  is  sent  from  the  receiver  to  the  sender  every  time  a  TCP  packet  is  correctly  received 
by  the  receiver.  An  acknowledgment  is  cumulative  in  the  sense  that  by  sending  an  ac¬ 
knowledgment  packet,  the  receiver  acknowledges  that  all  the  packets  sent  by  the  sender 
with  sequence  number  less  than  the  number  indicated  in  the  ACK  packet  were  correctly 
received.  In  the  case  where  a  packet  from  a  series  of  packets  is  lost,  the  receiver  produces 
acknowledgments  for  every  packet  that  is  correctly  received  after  the  lost  packet.  Each 
of  these  ACKs  acknowledges  that  packets  before  the  lost  one  are  correctly  received  but 
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Figure  2.1:  The  Gilbert-Elliott  model, 
there  is  still  one  packet  missing. 

If  the  current  window  size  is  less  than  the  slow-start  threshold,  then  TCP  is  in  the 
slow-start  phase  and  Wnew  =  Wcur  +  1  each  time  an  acknowledgment  is  received,  oth¬ 
erwise  TCP  is  in  the  congestion  avoidance  phase  and  Wnew  =  Wcur  +  1  per  round-trip 
time.  The  latter  suggests  that  the  increase  in  the  window  size  is  according  to  Wnew  = 
Wcur  +  1  /Wcur  for  every  received  acknowledgment.  TCP  assumes  a  packet  has  been 
lost  either  by  receiving  three  duplicate  ACKs  for  a  specific  packet,  or  by  a  timeout.  In 
both  cases  it  is  assumed  by  TCP  that  the  packet  was  lost  because  of  congestion  in  the 
network.  In  the  first  case  though,  since  the  network  is  able  to  deliver  packets  to  the  final 
destination  the  congestion  cannot  be  severe,  so  TCP  reacts  less  aggressively.  Particularly, 
the  slow-start  threshold  is  updated  by  taking  half  the  value  of  the  current  window  size, 
Snew  =  Wcur/ 2,  and  Wnew  =  Snew.  Thus,  after  the  arrival  of  three  duplicate  acknowl¬ 
edgments,  TCP  enters  the  congestion  avoidance  phase.  The  second  case  implies  a  severe 
congestion  in  the  network,  so  TCP  reacts  aggressively  by  setting  Snew  =  Wcur/ 2,  and 
Wnew  =  1.  This  reaction  causes  TCP  to  enter  the  slow-start  phase. 

The  packet  loss  model  associated  with  the  wireless  channel  can  be  described  by 
a  continuous  time  Markov  chain  with  two  states  as  shown  in  Fig.  2.1  and  known  as  the 
Gilbert-Elliott  model  [21,22]  which  is  frequently  used  in  the  literature  [1,24,42,56].  One 
state  corresponds  to  the  channel  being  “good”,  i.e.  packets  are  not  lost  w.p.  1,  and  the 
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other  state  corresponds  to  the  channel  being  “bad”  having  as  an  effect  packet  losses  w.p. 
1.  The  transition  rate  from  the  “bad”  to  the  “good”  state  is  Xbg  and  the  transition  rate  from 
the  “good”  to  the  “bad”  state  is  Xgb. 

The  MAC  layer  model  assumed  in  this  work  is  based  on  the  pure  Aloha  mech¬ 
anism  [2,  15,  51].  In  pure  Aloha,  if  a  packet  transmission  overlaps  at  all  with  that  of 
another  packet,  then  the  transmission  is  unsuccessful  for  all  the  packets  that  participated 
in  the  collision.  A  packet  that  failed  to  be  transmitted  successfully  is  retransmitted  after 
a  random  delay.  It  is  assumed  that  this  delay  is  a  random  variable  following  the  exponen¬ 
tial  distribution  with  mean  l/Xret  and  it  is  independent  of  any  previous  delays.  It  is  also 
assumed  that  a  feedback  is  immediately  available  to  the  nodes  informing  them  about  the 
successful  or  unsuccessful  transmission  of  a  packet. 

If  the  new  arrivals  to  the  system  are  Poisson  with  rate  A,  and  the  number  of  nodes 
that  have  packets  that  participated  in  a  collision  (backlog)  is  n,  then  the  initiation  times 
of  attempted  transmissions  follow  a  time-varying  Poisson  distribution  with  rate  G(n)  = 
A  +  nXret.  In  this  setting  the  probability  of  a  successful  transmission  of  a  packet  is, 


Pmac 


—  £  2  G(n)Tp 


(2.1) 


where  Tp  =  L/C  is  the  transmission  time  of  the  packet  of  constant  length  L  bits  over  the 
wireless  channel  of  capacity  C  bps.  We  assume  that  each  node  is  capable  of  estimating 
the  number  n  of  nodes  with  which  it  competes  for  bandwidth  and  therefore  can  estimate 
the  probability  of  successful  transmission  pmac- 

The  problem  attempted  to  be  solved  then  is  to  increase  the  TCP  performance  based 
on  the  models  described  above.  Usually  the  approach  taken  is  to  change  the  way  TCP 
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Figure  2.2:  System  model. 


operates  by  either  changing  the  finite  state  machine  of  the  protocol  or  introducing  new 
fields  in  the  TCP  header.  In  contrast  to  that,  our  approach  keeps  to  a  minimum  any 
required  changes  to  TCP,  so  that  compatibility  with  the  standard  TCP  implementations 
can  be  achieved. 

The  poor  performance  of  TCP  over  wireless  stems  from  the  fact  that  TCP  cannot 
distinguish  between  packet  losses  due  to  congestion  and  packet  losses  due  to  poor  channel 
quality.  As  a  result  treats  all  packet  losses  as  if  they  happen  because  of  the  congestion  in 
the  network.  The  TCP  sender  sets  a  timeout  period  for  each  packet  sent  to  the  network. 
If  no  acknowledgment  for  this  particular  packet  is  received  during  this  period,  the  packet 
is  considered  lost.  Each  packet  is  delayed  in  the  MAC  layer  because  of  collisions  and 
probably  is  lost  in  the  physical  layer  because  of  the  poor  channel  quality. 

In  this  chapter  we  attempt  to  develop  a  simple  model  for  the  window  size  evolution 
of  TCP  which  incorporates  the  dependencies  from  the  MAC  and  the  physical  layers. 


2.3  Analysis 

In  this  section  we  give  the  mathematical  models  that  describe  the  operation  of  each 
of  the  layers  involved  in  our  analysis.  In  the  following  we  assume  there  exists  a  complete 
probability  space  (0,  T .  P).  A  representation  of  the  system  is  given  in  Fig.  2.2. 


17 


2.3.1  Physical  Layer 


We  elaborate  on  the  model  for  the  Physical  layer  that  was  briefly  introduced  in 
Section  2.2.  We  define  the  continuous  time  Markov  chain  P  =  (Pt)t> o  with  a  state  space 
V  =  {0, 1}.  When  P,  =  0,  it  means  the  channel  is  in  the  “bad”  state  and  the  transmitted 
packet  is  dropped  w.p.  1,  when  Pt  =  1,  it  means  the  channel  is  in  the  “good”  state  and 
the  transmission  of  the  packet  is  successful  w.p.  1.  As  was  mentioned  in  Section  2.2, 
the  transition  rates  from  “bad”  to  “good”  and  from  “good”  to  “bad”  are  A bg  and  Xgb, 
respectively.  Then,  the  transition  probabilities  for  the  chain  in  a  small  time  interval  h  >  0 
can  be  given  by: 

Poo(h)  =  1  -  A bgh  +  o(h),  p0i{h )  =  A bgh  +  o(h) 

Pio{h )  =  A gbh  +  o(h),  Pn(h)  =  1  -  A gbh  +  o(h) 

where  o(h)  is  such  that  liiii/w0  =  0. 

In  Appendix  A.l  we  compute  the  probability  po(t)  the  chain  is  in  the  “bad”  state  at 
time  t  to  be: 

Po(t)  =  Ay  +  ( Po(0)  -  y^Xr)  e-(MW  (2.2) 

Abg  +  Agb  \  A bg  +  Agb  ) 

for  t  >  0  and  some  initial  probabilities  po(0)  and  j>\  (0  )  for  the  chain  to  be  in  the  “bad” 
and  the  “good”  state  respectively,  at  time  t  —  0. 

Since  p0(t)  +  pi(t)  =  1  for  all  t  >  0,  we  also  have: 

P,(t)  =  -A^_  +L(0)-%  A  k-(W  (2.3) 

Mg  +  Agb  \  Abg  +  Agb  J 

for  t  >  0.  The  stationary  distribution  for  the  Markov  chain  corresponds  to  the  case  where 
f  |  oo  in  (2.2)  and  (2.3).  The  stationary  probabilities  tt,,,  7ig  of  being  in  the  “bad”  and  the 
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“good”  states  respectively,  are: 


lim  p0(t)  = 

t — >oo 

^gb 

(2.4a) 

A bg  +  A gb 

lim  pi  (t)  = 

t—>  OO 

A bg 

(2.4b) 

A bg  +  A  gb 

In  Appendix  A.l  we  also  prove  that  the  waiting  time  7),  i  e  V  in  each  state  is 
exponentially  distributed  and  more  specifically, 


P{T0  >t}  =  e~Xbs\  t  >  0 

(2.5a) 

P{Ti  >t}  =  e~x°bt,  t  >  0 

(2.5b) 

As  was  mentioned  in  Section  2. 1  we  focus  on  the  effect  of  the  MAC  and  the  physical 
layer  on  the  timeout  mechanism  of  TCP.  Thus,  we  assume  the  physical  channel  (PHY- 
FW)  in  the  forward  direction  to  be  ideal.  This  means  that  Mt  and  MfMAC  are  indistin¬ 
guishable  and  there  are  no  duplicate  ACKs  produced  at  the  TCP  receiver.  Assuming  that 
the  Markov  chain  that  describes  the  physical  layer  operates  in  the  stationary  regime,  then 
the  effect  of  the  physical  layer  (PHY-B  W)  in  the  backward  direction  is  described  by  (2.4) 
and  (2.5).  In  particular,  the  process  N  =  (Nt)t>0  in  Fig.  2.2  is  a  thinned  version  of  the 
point  process  NMAC  =  (N™AC)t>Q  and  this  thinning  is  done  with  the  stationary  probabil¬ 
ity  ng  the  channel  is  in  the  good  state,  given  by  (2.4b). 


2.3.2  MAC  Layer 

In  this  section  we  give  a  more  detailed  description  of  the  MAC  layer  model  that  we 
use  in  our  analysis.  In  this  chapter  we  consider  the  pure  Aloha  protocol.  Each  packet  i 
is  successfully  transmitted  (i.e.  without  any  collisions  at  the  MAC  layer)  with  probability 
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pmac  that  is  given  by  (2.1)  and  the  transmission  time  in  this  case  will  be  constant  and 
equal  to  Tp  =  L/C  as  was  mentioned  in  Section  2.2.  A  collision  happens  with  probability 
1  —  Pmac  and  the  packet  has  to  wait  a  random  time  that  is  exponentially  distributed  with 
mean  1/Aret.  At  the  end  of  this  time  period  another  transmission  is  attempted.  If  there 
is  another  collision  the  packet  has  to  wait  again  for  some  time  which  is  exponentially 
distributed  with  mean  1/A ret  and  is  independent  of  any  previous  waiting  periods.  Since 
Pmac  >  0,  the  packet  will  eventually  be  transmitted  successfully. 

Since  each  packet  transmission  happens  independently  of  any  transmissions  of  pre¬ 
vious  packets,  if  we  define  DfAC  to  be  the  service  time  (the  time  from  the  moment  the 
packet  goes  to  the  head  of  the  queue  until  it  is  successfully  transmitted)  of  packet  i  in 
the  MAC  layer,  then  the  random  variables  {DfAC,  i  =  1,2,...}  form  an  i.i.d.  se¬ 
quence  represented  by  the  generic  random  variable  DMAC .  We  know  that  it  is  always  true 
D mac  >  Xp.  In  particular, 

K 

DMAC  =  Tp  +  Xj 

3= 1 

where  {Xj,  j  =  1,2, ...  .K\  are  i.i.d.  exponentially  distributed  random  variables  with 
mean  1/A ret,  and  I\  is  a  geometrically  distributed  random  variable  with  parameter  pmac, 
such  that 

P{K  =  k}  =  pmac(  1  -  pmac)k,  k  =  0, 1,  2, . . . 


In  Appendix  A. 2  we  show  that  the  characteristic  function  of  the  random  variable  DMAC 
is  given  by 


AsDmac 


Pmac  &  p  +  (1  Pmac ) 


A  ret.P, 


"mac  isTp 


A retPmac 


(2.6) 
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From  (2.6)  we  immediately  get  the  p.d.f.  of  the  random  variable  DMAC  to  be 


f dm  AC  (f )  — Pmac&(t  Tp)  T  Pmac(  1 


Pmac)  Xref6- 


A retPm 


(2.7) 


for  t  >  0,  where  uq  ( ' )  is  the  Heaviside  function: 


uo(t)  =  { 


0,  t  <  0 


1,  t>  0 


The  times  between  successful  packet  transmissions  at  the  MAC  layer  (assuming 
there  are  always  packets  to  be  transmitted)  are  independent  and  distributed  according 
to  (2.7),  forming  a  renewal  process.  If  we  define  the  corresponding  point  process  to  be 
{T™AC,  n  —  0.1,...},  with  T0MAC  =  0  P- a.s.,  then 


T 


MAC 


=  D™AC  +  ---  +  D 


MAC 


(2.8) 


where  DfIAC, . . . ,  D™AC  are  i.i.d.  random  variables  with  p.d.f.  given  by  (2.7)  and 

Ki 

D?ac  =  Tp  +  J2Xv  *  =  1,2 

3= 1 

where  Kt  is  geometrically  distributed  with  parameter  pmac  and  Xj  is  exponentially  dis¬ 
tributed  with  parameter  Xret.  Then, 

Kr  Kn 

Trc  =nTr+Y.Xi  +  ---+Y.Xj 

3= 1  i=1 

I< 

=  nTp  +  'y  '  Xj  (2.9) 

i=i 

where  K  is  the  sum  of  n  i.i.d.  geometrically  distributed  random  variables  with  parameter 
pmac-  It  is  shown  in  Appendix  A. 3  that  the  random  variable  K  has  a  negative  binomial 
distribution  with  parameters  n  and  pmac, 

P{K  =  k)  =  +  ^  -  Pmac)* 
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for  k  =  0, 1, ... .  Regarding  Y^f=i  xf 


E 


K 

j=l 


(2.10) 


which  means  that 


fz*  iX3  W  =  PmaJtt) 

n 

+ vn 

1  t'mac  /  j 


k= 1 


1  ~Pr 


(KetPmac)k  ^k-lc-\retPmact 


Pmac  J  (k  1 )  • 

for  t  >  0.  From  (2.9)  and  (2.11),  the  p.d.f.  for  TAIAC  is  computed 


(2.11) 


fTMAc(t )  =  /E*=iXj.(f  -  nTp ) 


=  -  nTp) 

'n\  fl-Pr 


+  pn  V 

1  rmac  /  j 


w  V  p. 


(KetPmac)k  ^  ^  ^fc-1  \retPmac(t-nTp) 


(k~l )! 


(2.12) 


for  t  >  nTp. 

We  define  the  counting  process  NMAC  =  (NAIAC)t>0  that  corresponds  to  the  point 
process  {TAIAC,  n  —  0, 1, . . .  }, 


NtMAC  =  1  [TAIAC  <t],t>  0  (2.13) 

i=  1 

where  1  [•]  is  the  indicator  function.  Although  the  sequence  {TAI+f —TAIAC ,  n  —  0, 1, . . .  } 
is  an  i.i.d.  sequence  defining  a  renewal  process,  the  counting  process  NMAC  does  not  have 
stationary  and  independent  increments  because  of  the  fact  that  Tp  >  0.  We  define  the 
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history  of  the  NMAC  process  as  the  right  continuous  filtration  pMAC  =  (F^MAC)t>o,  such 
that, 

T?MAC  =  <t{N?ao,  s<t}  =  a{T™pcAC,  s  <  t} 

To  compute  the  p^MAC  —compensator  J\ft  of  the  NMAC  process,  we  define  the  conditional 
distribution  functions: 


F,(l)  =  p{TAIAC  <  t} 


Fi{t )  =  P{T2mac  <  t  |  T™AC, . . . ,  T?AC],  i  >  2 


From  (2.8)  we  have  that 


T,  =  DlIAC,  P- a.s. 


and  using  (2.7)  we  compute  the  conditional  distribution  F\(-)  and  the  corresponding  p.d.f. 


flit)  =  PmacS(t  ~  Tp)  +  Pmac  ( 1  “  Pmac)Kete  XretPmac'  (*  Tp )  U0(t  -  Tp) 


and 


Fi(t)  =  { 


0, 


Pr 


t  <  Tn 


+  (1  -  Pmac)  (l  -  e  XretPmac  (*  )  ,  t 


>  T 

—  -Lp 


From  (2.8)  we  notice  that 


TMAC  =  TMAC  +  DMA G,  f  >  2 


thus, 


F*(f)  =  P{D™AC  <  t  -  TftAC  |  T^f7},  i  >  2 
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Using  (2.7)  we  get  the  conditional  distribution  F,(-)  and  the  corresponding  p.d.f.  /;(•), 


i  >  2: 


m  =  Pmac5(t  -  T^c  -  Tp) 


Pr 


:(1  -  Pmac)Kete~XretPmaC'^T^C  ^  U0(t  ~  T™f  -  Tp) 


and 


m  =  { 


0, 


t  <  T™AC  +  Tt 


Pmac  +  (1  -  pmac)e~XretPmac  T*>)  )  ,  t>  T^C  + 


T 

-*■  n 


We  proceed  by  defining 


,,AT*«C  df.i(u) 


'0 


1  -  Fi{u~) 


tArMAC 


fi{u) 


1  —  FAu~ 


-du, 


i  >  1 


Then, 


=  < 


0, 


A retPmac  (t  A  F\  Tpj  , 


0  <  t  <  Tp 
Tp  <  t 


and 


a!*1  =  i 


o, 


retPmac 


( t  A  Ti 


rnMAC 
1  i—1 


TP), 


0  <t<  T™AC  +  Tp 


+  Tp  <  t 


fori  >  2.  From  [17,  T7  Theorem,  p.61]  and  [34,  Theorem  18.2,  p.270]  the  ^MAC 
At  of  the  Nmac  process  is  given  by 


p^MAC 


5> 

i>  1 


w 


compensator 
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and  using  A(fl) ,  i  >  1  computed  above,  we  have 


AfAC  =  { 


A  m  (  jmac  _  aj  \ 

/'retlJmac\±  % 


TMAC  <  t  <  JIM  AC  + 


(2.14) 


A retPmact  ~  (*  +  1 )  KetPmacTp ,  T^AC  +  Tp  <  t  <  T%_f 


The  jr/v'v,  4C  —intensity  Af/AC  can  be  computed  directly  from  (2.14)  to  be: 


Af AC  =  <! 


0, 


TtMAC  <  t  <  TtMAC  +  Tp 


(2.15) 


' retf'mac 5 


2.3.3  Transport  Layer 


To  describe  the  evolution  of  the  window  size,  two  stochastic  processes  W  =  (VL)t>o 
and  H  =  (. Ht)t>o  are  defined,  where  It7,  is  the  window  size  of  the  TCP  flow,  and  II,  is 
the  corresponding  slow-start  threshold  at  time  t. 


2.3.3. 1  Underlying  Point  Processes 

Given  the  description  in  Section  2.2,  there  exist  two  underlying  strictly  increasing 
sequences  of  random  variables  representing  two  point  processes: 

•  for  the  arrival  of  acknowledgments  {Tn,  n  =  0, 1, ...  }  with  T0  =  0,  P- a.s.  and 
intensity  A*  >  0,  and 

•  for  the  timeout  events  {Sn,  n  —  0,1,...}  with  S0  =  0,  P- a.s.  and  intensity  fj,t  >  0. 

The  point  process  {Tn,  n  —  0, 1, ...  }  represents  the  arrival  of  acknowledgments  at 
the  TCP  sender,  and  is  closely  related  to  the  MAC  and  the  physical  layer.  With  the  as¬ 
sumption  that  there  are  always  acknowledgments  waiting  transmission  at  the  MAC  layer 
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at  the  TCP  receiver  side,  it  was  shown  in  Section  2.3.2  that  the  successful  (i.e.  without 


collisions)  transmissions  of  acknowledgments  at  the  MAC  layer  form  a  renewal  process. 

The  assumption  that  there  are  always  acknowledgments  at  the  receiver  side  waiting 
for  transmission  at  the  MAC  layer  is  a  strong  one.  The  ramification  of  this  assumption 
is  two  fold:  (i)  we  underestimate  the  inter-ack  time  intervals,  and  (ii)  we  decouple  the 
forward  and  backward  channel  in  the  sense  that  any  delays  introduced  to  the  data  packet 
transmission  times  by  the  MAC  layer  in  the  forward  channel  are  not  preserved  in  the 
acknowledgment  point  process  in  the  backward  channel. 

Those  acknowledgments  that  survived  collisions  at  the  MAC  layer  are  subject  to 
the  quality  of  the  physical  layer.  Thus,  each  of  these  acknowledgments  is  successfully 
received  at  the  TCP  sender  with  probability  7 ig  that  is  given  by  (2.4b)  and  this  happens 
independently  of  the  operation  of  the  MAC  layer  (thinning  of  the  point  process),  assuming 
the  Markov  chain  that  represents  the  physical  layer  operates  at  the  stationary  regime. 

t> 0  is  the  right  continuous  filtration  that  represents  the  history  of  the 
point  process  {Tn,  n  —  0, 1, . . .  },  then  the  -intensity  Xt  of  the  process  is 

At  =  ng\fAC  (2.16) 

where  ng  is  given  by  (2.4b)  and  \fAC  is  given  by  (2.15). 

For  each  packet  sent  to  the  network,  TCP  expects  an  acknowledgment  back  from  the 
receiver  acknowledging  the  receipt  of  the  packet.  In  the  case  of  poor  channel  quality  such 
an  acknowledgment  may  be  lost.  If  the  TCP  sender  does  not  receive  the  acknowledgment 
in  certain  amount  of  time  it  will  assume  the  packet  was  not  properly  received  by  the 
receiver  and  will  retransmit  it,  minimizing  at  the  same  time  its  window  size  and  in  effect 
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the  throughput  of  the  connection.  In  a  wireless  network  though  an  acknowledgment  may 
experience  delays  because  of  the  MAC  and  the  collisions  that  take  place  when  accessing 
the  channel.  Thus,  the  TCP  sender  should  not  be  anxious  declaring  a  timeout  and  in  effect 
minimizing  the  sending  rate  to  the  network.  On  the  other  hand,  the  more  the  TCP  sender 
is  waiting  for  the  arrival  of  an  acknowledgment,  the  more  the  connection  remains  idle 
resulting  in  performance  degradation. 


2.3. 3. 2  The  Slow-Start  Threshold  Process  H  =  (Ht)t> o 


Based  on  the  point  processes  defined  above,  the  stochastic  process  H  that  represents 
the  slow-start  threshold  in  TCP  is  given  by: 


H0  =  h,  P- a.s. 


(2.17) 


Ht  =  h  +  1  [sn  <  t]  A HSn,  t>  0 


n=  1 


where  h  is  given.  The  sample  paths  of  H  defined  by  (2.17)  are  piecewise  constant  and 
right  continuous  with  left  limits  (cadlag  process).  The  magnitude  of  each  jump  at  the 
points  of  the  process  { Sn ,  n  —  1,  2, . . .  }  is  given  by 

A  HSn  =  HSn  -  Ho- 


=  H?  -  H 


=  max  <  2, 


s„~  i 
Wq 


W, 


Sn-! 


=  < 


if^>4 


2  - 


w; 


2  ’ 


otherwise 


27 


for  n  —  2,3, ... ,  and 


AHSl  =  HSl  -  Hs- 
=  HSl  -  HS o 
=  max  1 2,  ^  J  -  II s<> 

^t-h,  if  W£>4 
2  —  h,  otherwise 
and  it  is  zero  for  all  the  other  time  instances. 

2.3. 3. 3  The  Window  Size  Process  W  =  {Wt)t> o 

As  was  described  in  Section  2.2,  the  window  size  evolution  is  driven  by  the  two 
point  processes  {Tn,  n  —  0, 1, . . .  },  and  {Sn,  n  —  0, 1, . . .  }. 

During  the  slow-start  phase  the  window  size  is  increased  by  1  for  every  received 
acknowledgment.  Define  the  counting  process  N  =  o  that  is  associated  with  the 

point  process  {Tn,  n  —  0,1,...}  and  counts  the  received  acknowledgments: 

OO 

Nt  =  J2  l[Tn<t],t>0 

i= 1 

Then,  in  the  slow-start  phase  the  window  size  evolves  according  to 

Wt  —  W0  +  Nt,  t  >  0  (2.18) 

where  W0  is  given.  As  was  described  in  Section  2.2  the  evolution  of  the  window  size  in 
congestion  avoidance  phase  is  more  conservative  compared  to  the  case  of  the  slow-start 
phase.  Based  on  that  description  the  window  size  evolution  in  the  congestion  avoidance 
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phase  is  described  by 


dWt  =  dNt ,  t  >  0  (2.19) 

The  continuous  time  evolution  of  the  window  size  is  characterized  by  (2.18)  and  (2. 19)  for 
slow-start  and  congestion  avoidance  respectively.  It  starts  in  the  slow-start  phase  and  if 
there  are  no  timeouts  it  switches  to  the  congestion  avoidance  phase  whenever  the  window 
size  Wt  becomes  larger  than  the  slow-start  threshold  Ht.  Whenever  the  window  size 
IT)  reaches  its  maximum  allowable  value  Wmax,  it  remains  to  this  value.  In  any  case, 
whenever  a  timeout  occurs,  TCP  switches  to  slow-start  and  sets  the  window  size  to  its 
minimum  value  Wo'. 


Wsn  —  W0,  n  —  1,2,... 

and  the  window  size  evolves  according  to  (2.18).  To  summarize,  the  window  size  evolu¬ 
tion  is  described  by: 


dWt  =  < 


dNt,  Wt  <  Ht 


WtdNu  Wt>Ht 


WSn  =  W0,  n  =  1,2,... 


(2.20) 


W0<Wt<  Wmax,  t  >  0 


Note  that  both  processes  W  =  (Wt)t> o  and  H  =  (Ht)t>o  are  fully  observable  by  the  TCP 
sender  (controller). 
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2.4  Validation  of  the  Model 


We  compare  the  analytical  results  given  by  (2.20)  against  ns-2  [54]  simulations. 
For  the  ns-2  simulations  a  detailed  model  of  the  pure  (unslotted)  Aloha  protocol  was 
developed  for  the  wireless  network  protocol  stack.  The  wireless  network  is  a  single  cell 
where  all  nodes  can  hear  each  other.  In  all  the  experiments  we  establish  a  TCP  Tahoe 
connection  between  two  wireless  nodes.  The  TCP  connection  is  used  to  serve  a  persistent 
FTP  transfer  for  the  duration  of  each  experiment.  In  the  neighborhood  of  these  nodes 
there  are  pairs  of  nodes  that  exchange  data  packets  over  UDP  connections  that  serve 
CBR  traffic.  The  CBR  traffic  provides  the  background  traffic  that  contributes  to  packet 
collisions  at  the  MAC  layer.  Both  TCP  and  UDP  data  packets  are  1024  bytes  long.  Each 
CBR  connection  has  a  rate  of  64kbps  and  implements  the  ns-2  mechanism  of  random 
perturbation  of  the  packet  transmission  times.  Moreover,  we  introduce  random  packet 
losses  that  simulate  packet  errors  due  to  fading  and  channel  quality  degradation.  The 
channel  capacity  in  all  experiments  is  2Mbps. 

In  Fig.  2.3  the  window  size  of  the  TCP  Tahoe  connection  is  shown  for  both  the 
analytical  results  given  by  (2.20)  and  the  ns-2  simulation.  The  network  consists  of  the  two 
nodes  that  participate  in  the  TCP  connection  and  20  nodes  that  provide  the  background 
traffic  and  thus  the  collisions  at  the  MAC  layer.  In  this  scenario  there  are  no  packet 
losses  due  to  low  channel  quality  and  thus  there  are  no  timeout  events  at  the  TCP  sender. 
Because  of  that,  the  TCP  sender  starts  in  the  slow-start  mode  of  operation  and  when  the 
slow-start  threshold  is  reached  it  switches  to  the  slower  regime  of  congestion  avoidance. 
The  mean  exponential  backoff  duration  for  the  MAC  is  O.lsec. 
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Congestion  Window  Evolution  -  Without  channel  losses 


Figure  2.3:  Window  size  evolution  in  the  absence  of  channel  losses  (22  nodes). 

Similarly,  Fig.  2.4  shows  the  window  size  for  the  analytical  as  well  as  the  simulation 
results.  In  this  case,  the  background  traffic  is  created  by  40  nodes.  As  before,  there  are  no 
channel  errors  but  there  are  timeouts  because  of  packet  losses  due  to  multiple  collisions 
at  the  MAC  layer. 

In  Fig.  2.5  the  window  size  is  shown  for  the  same  network  of  22  nodes  but  in 
the  presence  of  packet  losses  due  to  channel  quality  degradation.  The  mean  exponential 
backoff  duration  after  a  collision  is  O.lsec.  In  this  experiment,  the  transition  rates  between 
the  two  states  of  the  Markov  chain  that  models  the  channel  losses  are  A gb  =  1  and  Xbg  =  2. 
From  (2.5a)  and  (2.5b)  we  can  then  compute  the  expected  duration  of  each  state  (and  thus 
the  effect  of  channel  losses  to  the  data  exchange)  to  be 

E[T0]  =  — =  0.5  sec 

Xbg 
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Congestion  Window  Evolution  -  Without  channel  losses 


Figure  2.4:  Window  size  evolution  in  the  absence  of  channel  losses  (42  nodes). 

E[Ti]  =  — =  1  sec 

A  gb 


The  scenario  in  Fig.  2.6  is  for  a  network  of  42  nodes.  The  mean  exponential  backoff 
duration  is  O.lsec  and  the  transition  rates  for  the  Markov  chain  are  A gb  =  0.1  and  A bg  =  1 
giving  mean  durations  for  the  ’’bad”  and  the  ’’good”  state  E[T0]  =  1  sec  and  E[Ti]  = 
10  sec  respectively. 
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window  size  (packets)  window  size  (packets) 


Congestion  Window  Evolution  -  With  channel  losses 


Figure  2.5:  Window  size  evolution  with  channel  losses  (22  nodes). 


Congestion  Window  Evolution  -  With  channel  losses 


Figure  2.6:  Window  size  evolution  in  the  absence  of  channel  losses  (44  nodes). 
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Chapter  3 


Optimal  Timeout  Mechanism  of  TCP  over  Aloha 

This  chapter  presents  an  optimization  problem  that  aims  to  maximize  the  through¬ 
put  of  a  Transmission  Control  Protocol  (TCP)  connection  between  two  nodes  in  a  wireless 
ad-hoc  network.  More  specifically,  the  setting  is  the  one  introduced  in  Chapter  2,  where 
a  persistent  TCP  connection  is  established  between  two  nodes  that  are  one  hop  away  in 
a  wireless  unslotted  Aloha  network.  The  optimization  is  over  the  TCP  timeout  period, 
i.e.  the  problem  is  to  find  the  optimal  waiting  period  before  the  TCP  sender  declares  a 
timeout  event  in  the  absence  of  a  received  acknowledgment  for  a  transmitted  packet.  The 
problem  is  formulated  as  an  optimal  stopping  problem.  In  the  absence  of  a  tractable  an¬ 
alytical  solution  to  the  problem,  a  numerical  method  is  proposed  to  achieve  performance 
improvement  of  the  system. 

3.1  Introduction 

As  was  mentioned  in  Chapters  1  and  2,  the  performance  of  TCP  over  a  wireless 
network  is  poor.  This  is  because  the  TCP  sender  assumes  that  the  reason  for  a  packet  loss 
is  congestion  in  the  network.  Although  this  is  a  reasonable  assumption  for  the  Internet, 
it  might  not  be  the  case  for  wireless  networks.  The  successful  transmission  of  a  packet 
over  a  wireless  channel  depends  on  the  channel  quality.  In  wireless  networks  the  channel 
quality  exhibits  high  variability  and  it  often  causes  unrecoverable  errors  for  the  packet  at 
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the  receiver.  In  these  cases,  the  TCP  receiver  cannot  acknowledge  the  received  packet  and 
drops  it.  When  packets  are  dropped  due  to  bursts  of  errors  introduced  at  the  channel  level, 
the  TCP  sender  declares  a  timeout  in  the  absence  of  received  acknowledgments.  When 
this  happens,  TCP  enters  the  slow-start  phase  minimizing  its  window  size,  and  thus  its 
throughput.  Clearly,  this  is  not  the  best  remedy  to  the  problem,  since  the  lost  packets  are 
dropped  because  of  a  temporary  quality  degradation  at  the  channel  and  not  because  of 
congestion. 

The  same  situation  arises  when  the  channel  affects  the  transmission  of  the  acknowl¬ 
edgments  themselves.  Typically,  in  the  case  of  a  bidirectional  TCP  connection,  the  ac¬ 
knowledgments  for  the  one  direction  are  piggybacked  onto  the  data  packets  to  the  opposite 
direction.  Hence,  acknowledgments  are  subject  to  the  effect  of  the  channel  as  data  pack¬ 
ets  do.  Even  in  unidirectional  TCP  connections  where  the  acknowledgments  are  sent  to 
the  sender  on  their  own,  the  bursty  nature  of  the  channel  errors  increases  the  probability 
that  more  than  three  consecutive  acknowledgments  are  lost  and  thus  a  data  packet  loss  is 
falsely  detected  at  the  TCP  sender  and  a  timeout  is  declared. 

It  makes  sense  then  to  try  to  maximize  the  TCP  throughput  by  appropriately  tuning 
the  timeout  interval  for  each  packet  the  TCP  source  sends  to  the  network.  This  tun¬ 
ing  should  take  into  consideration  the  parameters  that  characterize  the  operation  of  the 
Medium  Access  Control  (MAC)  layer  as  well  as  the  channel.  In  the  setting  considered 
here,  these  parameters  are  the  mean  backoff  time  \ret  for  unslotted  Aloha  and  the  proba¬ 
bilities  the  wireless  channel  is  in  the  “good”  or  the  “bad”  state,  7 rs,  7r b  respectively. 

After  a  packet  is  sent  to  the  network  the  TCP  sender  starts  a  timer  which  is  set  to 
a  value  according  to  an  estimate  of  the  round-trip  time  (RTT).  In  general,  in  current  TCP 
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implementations  this  estimate  does  not  take  into  account  the  fact  that  the  communication 
takes  place  over  a  wireless  network  and  thus  it  considers  any  delays  to  be  associated  with 
congestion.  In  a  wireless  environment  however,  especially  in  random  access  networks 
such  as  the  IEEE  802.11  or  Aloha  (as  is  the  case  here),  packets  are  delayed  because  of 
collisions  and  retransmissions  at  the  MAC  layer.  If  a  packet  is  delayed  because  there  is 
heavy  background  traffic  (i.e.  traffic  from  or  to  nodes  in  the  neighborhood  of  the  TCP 
sender  or  receiver),  its  acknowledgment  might  not  reach  the  TCP  sender  before  the  expi¬ 
ration  of  the  timeout  timer.  Then,  the  TCP  sender  will  declare  a  timeout,  it  will  minimize 
the  window  size  and  enter  slow-start.  This  will  happen  even  if  there  is  no  congestion  be¬ 
tween  the  TCP  sender  and  receiver.  In  this  case  the  TCP  throughput  is  minimized  without 
any  congestion  being  present  in  the  network. 

Consider  the  situation  from  the  point  of  view  of  the  TCP  sender.  In  the  current 
TCP  implementations  the  TCP  sender  at  some  point  sends  a  packet  and  starts  the  timeout 
timer.  If  no  acknowledgment  is  received  for  that  packet  when  the  timer  expires,  the  TCP 
sender  declares  a  timeout  and  enters  slow-start.  The  TCP  sender  has  no  way  to  know 
the  exact  cause  for  the  lack  of  a  received  acknowledgment  and  it  always  assumes  there 
is  congestion  in  the  network.  If  we  want  to  maximize  the  TCP  performance  we  need  to 
incorporate  in  the  timeout  mechanism  some  information  regarding  the  wireless  medium. 
Consider  again  the  situation  where  the  TCP  sender  sends  a  packet  to  the  network  and  waits 
for  an  acknowledgment.  There  are  two  reasons  for  an  acknowledgment  to  be  delayed. 
Either  there  is  congestion  in  the  network  or  the  packet  is  delayed  because  of  collisions 
and  retransmissions  at  the  MAC  layer.  In  the  first  case  the  TCP  sender  would  have  liked 
to  declare  immediately  a  timeout  and  enter  slow-start  and  thus  minimize  the  traffic  that  is 
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sent  to  the  network  in  order  to  compensate  for  the  congestion.  In  the  second  case  however, 
a  timeout  event  is  not  the  best  thing  to  do  because  the  cause  of  the  delay  is  the  MAC  layer 
and  not  congestion  at  the  transport  layer.  In  this  case  the  TCP  sender  would  have  liked 
to  wait  and  let  the  MAC  layer  resolve  the  collision.  Then,  the  received  acknowledgment 
would  trigger  the  transmission  of  packets  from  the  current  state  of  the  TCP  sender  and 
thus  no  performance  decrease  would  be  observed  regarding  the  TCP  throughput. 

It  is  clear  then,  that  the  TCP  sender  has  to  choose  between  two  different  actions  in 
the  absence  of  a  received  acknowledgment.  Either  stop  the  waiting  period  and  enter  slow- 
start  (by  essentially  declaring  a  timeout),  or  continue  waiting  for  the  acknowledgment, 
hoping  that  it  is  delayed  at  the  MAC  layer  and  not  because  of  congestion.  Thus,  an 
optimal  stopping  problem  can  be  defined.  The  solution  to  this  problem  provides  the  TCP 
sender  with  the  optimal  timeout  period  in  order  to  increase  its  throughput. 

3.2  Problem  Formulation 

The  setting  is  the  same  as  in  Chapter  2.  We  assume  there  exists  a  complete  proba¬ 
bility  space  (fi,  T.  P ).  We  consider  a  wireless  network  where  the  MAC  layer  is  unslotted 
(pure)  Aloha.  Each  node  in  the  network  can  hear  the  transmissions  from  any  other  node 
(single  cell).  We  model  the  wireless  channel  as  a  two-state  continuous  time  Markov  chain. 
One  state  corresponds  to  the  case  the  channel  is  “good”,  i.e.  the  packets  are  not  lost  w.p. 
1,  and  the  other  state  corresponds  to  the  case  the  channel  is  “bad”  which  means  the  trans¬ 
mitted  packets  are  lost  w.p.  1.  The  transition  rate  from  the  “bad”  to  the  “good”  state  is 
A bg  and  the  transition  rate  from  the  “good”  to  the  “bad”  state  is  X,,ir 


37 


In  the  unslotted  Aloha  protocol  a  packet  is  immediately  transmitted  to  the  network. 
If  this  transmission  overlaps  with  another  packet  transmission  from  another  node,  then 
there  is  a  collision  and  neither  of  the  packets  are  received  by  the  corresponding  receivers, 
and  have  to  be  retransmitted.  To  avoid  another  collision,  the  nodes  that  participated  in  the 
collision  have  to  delay  their  retransmission  for  an  exponentially  distributed  random  inter¬ 
val.  The  mean  of  this  exponential  distribution  is  the  same  for  all  nodes  and  is  denoted  by 
1/A ret.  Moreover,  this  randomly  selected  interval  is  independent  of  any  possible  previous 
delays  at  each  node  and  across  nodes. 

We  focus  on  a  TCP  connection  between  two  nodes  in  the  network  that  are  one  hop 

away.  We  assume  this  is  a  persistent  TCP  connection  which  implies  that  the  sender  has 

always  packets  to  send.  If  Wt  is  the  TCP  window  size  at  the  sender  at  time  t,  we  can 

define  a  stochastic  process  W  =  (Wt)t> 0  that  evolves  according  to  the  dynamics  of  the 

TCP  protocol  and  affected  by  the  MAC  layer  and  the  wireless  channel. 

In  Section  2.3  of  Chapter  2  we  provided  Eq.  (2.20)  which  is  a  stochastic  differential 

equation  that  describes  the  evolution  of  the  window  size  as  this  evolution  is  driven  by  a 

point  process  that  represents  the  arrival  of  acknowledgments  from  the  TCP  receiver  to  the 

TCP  sender.  More  specifically,  we  have: 

' 

dNt,  Wt  <  Ht 

dWt  =  < 

WtdN*  Wt>Ht 

WSn  =  W0,  n  =  l,2-,,..  (3.1) 

Wq  <  Wt  <  Wmax,  t  >  0 

where  H  =  (. Ht)t>0  is  the  process  that  describes  the  slow-start  threshold  and  is  given 
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by  (2.17).  W0  and  Wmax  are  the  initial  (minimum)  and  maximum  values  of  the  window 
size,  and  {Sn,  n  =  0, 1, . . .  }  is  the  sequence  of  the  time  instances  a  timeout  event  is 
declared  by  the  TCP  sender.  The  stochastic  process  N  =  (Nt)t>o  is  the  counting  process 
that  corresponds  to  the  point  process  {TAIAC ,  n  —  0,1,2,...}  that  represents  the  arrival  of 
acknowledgments  at  the  TCP  sender.  If  =  (7rfiV)t>0  is  the  right  continuous  filtration 
that  represents  the  history  of  this  point  process,  it  was  shown  in  Section  2.3.3  of  Chapter  2 
that  the  -intensity  A,  of  the  process  is 


Af  = 


A bg 


A ba  +  A 


gb 


yMAC 


(3.2) 


where 


( 


yMAC 


TtMAC  <  t  <  Taiac  +  Tp 


(3.3) 


[  A retPmac,  T™AC  +  Tp  <  t  <  T™AC 

and  Tp  =  L/C  is  the  transmission  time  of  the  packet  of  constant  length  L  bits  over  the 
wireless  channel  of  capacity  C  bps,  and  pmac  is  the  probability  of  a  successful  transmis¬ 
sion  of  a  packet  for  unslotted  Aloha  given  by  (2.1) 

As  was  mentioned  in  Section  3.1  we  want  to  increase  the  TCP  throughput  by  com¬ 
puting  the  optimal  timeout  period  r  for  the  TCP  sender  to  declare  a  timeout.  This  can 
be  formulated  as  an  optimal  stopping  time  problem  in  the  probability  space  (0,  T .  P ).  If 
jztcp  _  prep js  ^e  right  continuous  filtration  that  represents  the  history  of  events 
observed  by  the  TCP  sender  we  want  to  find  the  optimal  jFTC,p-stopping  time  r  such  that 


J(w,  r;  h )  = 


e-^k(Wt]  h)dt  +  e~0Tg(WT]  h) 


(3.4) 


Co  J 

is  maximized  over  r,  for  j3  >  0,  where  E„.  [•]  represents  the  expected  value  conditioned 
on  the  event  that  the  initial  value  of  the  process  W  is  w  and  the  slow-start  threshold  is  h. 
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The  value  h  of  the  slow-start  threshold  remains  constant  for  the  duration  of  the  timeout 
period  and  it  only  affects  the  size  of  the  window  if  an  acknowledgment  is  received.  The 
value  function  V(-\h)  for  the  problem  can  then  be  defined  as: 

V(w,  h)  —  sup  J(w,  r;  h)  (3.5) 

T 

Notice  that  the  two  filtrations,  JrN  and  jFTCP  are  equal  since  the  TCP  sender  observes 
the  arrival  of  acknowledgments.  Moreover,  the  arrival  of  acknowledgments  dictates  the 
evolution  of  the  process  W  =  (Wt)t> o- 


3.3  Hamilton- Jacobi-Bellman  (HJB)  Equation 

Let  B  denote  the  optimal  stopping  set,  i.e.  the  process  stops  when  the  set  B  is 
reached  for  the  first  time.  Then,  the  equation  satisfied  by  the  value  function  V(-;  h )  is 
known  as  the  Hamilton-Jacobi-Bellman  (HJB)  equation  and  is  [31,49]: 


CV (w;  h)  —  (3V (w;  h )  +  k(w,  h)  =  0,  w  ^  B 
V(w,h)  =  g(w;h),  wEB 


(3.6) 


where  C  is  the  infinitesimal  generator  of  the  process  W  defined  on  a  function  /  :  3?  — >  3? 


as: 

£/(«)  =  ,  i„«^M  (3.7) 

v  ’  no  t 

To  see  the  validity  of  (3.6)  take  A  >  0  and  small,  and  for  convenience,  drop  the 
parameter  h  from  all  the  expressions  in  the  following.  Suppose  that  at  some  point  the 
system  is  at  state  w.  At  that  moment  we  can  either  stop  or  continue  the  process.  The  gain 
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from  stopping  the  process  is  g(w),  which  means  that 


V{w)  =  g(w) 


for  w  e  B,  the  stopping  set.  If  the  decision  is  to  continue,  the  value  function  takes  the 


value 


V(w)  =  EW\  e~0tk(Wt)  dt  ,  for  w^B 


In  this  case  we  have: 


e~0tk(Wt)  dt  +  /  e-0tk(Wt)  dt  ■  l[r  >  A] 


=  EW\  e~0tk{Wt )  dt  +  e~0A  /  e-^-A)k(Wt)  dt  ■  l[r  >  A] 


e~0tk{Wt)  dt  +  /  e~0tk(Wt)  dt  ■  1[t  <  A] 


+  Ew  e~0A  /  e-/3(4”A)A;(lEt)  dt  •  l[r  >  A] 


e-/3^(W/t)  dt  +  /  e-/3^(lEi)  df -l[r  <  A] 


+  EW  e_/3A  •  Ewa  /  e-/3('-A)A;(lEt)dt-l[r>  A] 


where  ![•]  is  the  indicator  function.  But 


V(WA)=  EWa  /  e-0{t-A)k(Wt)dt-l[r>  A] 


Then,  the  equation  for  the  value  function  becomes 


V(w)  =  Ew  /  e~0tk(Wt )  dt  +  E„,  /  e~0tk(Wt)  dt  •  l[r  <  A] 

Lio  J  Lio 


+  e_/3AEU)  [y(WA)] 
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Add  and  subtract  Ew  [V (H  a)]  to  get 


0  =  [V(WA)\  -  V(w)  +  {e~0A  -  1)EW  [V(WA)]  +EW\  [  e-ptk(Wt)  dt 

Jo 

+  Ew  [  e~ptk(Wt )  dt  ■  1[t  <  A] 

[Jo 

Divide  both  sides  by  A: 

1  /  \  e~dA  —  1  I  r  fA 

0= -(Ew[V(Wa)}-V(w))+ - - - Ew[V(Wa)\  +  -Ew  /  e~0tk(Wt)dt 

LJ  0 

+  ^E,„  J  e~ptk(Wt)  dt  ■  1[t  <  A] 

Letting  A  {  0: 

0  =  CV(w)  ~/3V(w)  +  k(w) 

Moreover,  whenever 

CV{w)  —  /3V(w )  +  k(w )  =  g{w) 

it  does  not  matter  whether  we  stop  or  continue  since  this  has  no  effect  on  the  total  gain. 

In  general,  as  it  can  be  seen  from  the  computation  presented  above,  it  is  always  true 

that 

V{w)  >  g(w) 

and  it  is  V(w )  =  g(w)  only  when  the  process  is  stopped.  Thus,  the  optimal  strategy 
is  simple  enough,  we  should  stop  whenever  the  condition  V(w )  =  g(w)  holds  and  this 
happens  for  w  6  B,  the  stopping  set.  The  problem  of  solving  the  HJB  equation  (3.6) 
using  analytical  methods  is  hard  because  the  stopping  set  B  is  not  known,  but  it  is  part  of 
the  solution  [49].  In  probabilistic  terms,  Snell  [53]  has  shown  that  the  stochastic  process 
V(Wt)  is  the  smallest  supermartingale  that  dominates  the  process  g(Wt).  However,  it  is 
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not  easy  to  find  this  supermartingale  using  analytical  methods  and  someone  has  to  rely  on 
numerical  methods  for  its  computation. 

It  can  also  be  shown  [49]  that  the  optimal  stopping  problem  for  a  Markov  process 
X  is  equivalent  to  the  problem  of  finding  the  smallest  superharmonic  function  which 
dominates  a  properly  defined  gain  function  on  the  state  space  of  the  Markov  process  X. 
This  connection  can  be  seen  through  (3.6)  which  appears  in  both  types  of  problems. 


3.4  Preliminary  Analysis  for  the  Numerical  Approximation 

This  section  presents  some  results  that  will  be  needed  for  the  numerical  approxima¬ 
tion  to  the  optimal  stopping  problem. 


3.4.1  Jump  Process 


In  Section  2.3  of  Chapter  2  we  have  defined  the  point  process  {TAIAC ,  n  —  0,1,2,...} 
and  the  corresponding  counting  process  N  =  ( Nt)t>0 .  The  analysis  in  Chapter  2  provides 
the  T7  v-compcnsator  At  for  N  which  is: 


( 


At  —  < 


it  \  (tmac->T) 

g/\rethJmac\J- 1  L-Lp)’> 


TMAC  <  t  <  T0MAC  +  T, 


(3.8) 


KgXretPmact  ~  (i  +  l)lT  g\retpmacTp,  T%MAC  +  Tp  <  t  <  T^AC 


Because  of  the  way  this  compensator  was  computed  it  is  implied  [17]  that  the  process 
M  =  (Mt)t> o  defined  as  Mt  =  Nt  —  At  for  t  >  0,  is  an  TN -martingale.  That  means  that 
for  0  ^  s  ^  t  it  holds  that: 


E  [Mt  |  Ts]  =  Ms 
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E[E [Mt  |  Fa]]  =  E [Ms\  => 

E[Mt]  =  E  [Ms]  => 

E[M(]  =  E[M0]  =  0,  P-a.s.  for  all  t  >  0 

Then,  we  have  that 

0  =  E [Mt]  =  E [Nt]  -  E[At]  =>  E [Nt\  =  E[At],  t  >  0 
To  compute  the  value  of  E[At]  we  consider  two  cases: 

Ti  <  t  <  Ti  +  Tp:  In  this  case  At  =  ngXretpmac(T^AC  -  iTp)  so  we  get: 

E  [Nt]  =  E[At] 

=  ng\retPmac{^[TzMAC]  -  lTp ) 

^g^retPmac^  Ej=  i  xj\ ,  from  (2-9) 

=  ^gPlmacS (h  Pmac) ,  see  Appendix  B .  1 

where  P(i,p)  =  El=o  Qk  (r^)  • 

Ti  +  Tp<t<  Ti+1:  In  this  case  At  =  irgXretpmact  -  (i  +  l)ngXretpmacTp,  so  we  have 

E[A^f]  E[At]  TT gXretPmaCt  (i  T  1  )^gX  retPmac^p 

Notice  that  if  we  set  Tp  =  0,  then 

E[ATt]  =  TlgXretPmact ,  t  >  0 

and  the  process  becomes  a  Poisson  point  process. 
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If  £>(K)  is  the  Borel  cr-algebra  on  9R  and  U  G  B($t)  such  that  0  ^  U  (i.e.  0  does 
not  belong  to  the  closure  of  U ),  we  can  define  the  Poisson  measure  N  :  [0,  oo)  x  — > 
{0, 1,2,...}  associated  with  the  counting  process  N  =  ( Nt)t>o  as 

N (t,U)  =  e  Ul 

0  <s<t 

where  ANS  =  Ns  —  Ns~.  The  Poisson  measure  counts  the  number  of  jumps  up  to  time  t 
that  have  size  that  belongs  to  U. 

The  Levy  measure  v  :  — >  K  is  defined  as 

u(U)=E[N(l,U)] 

for  U  E  B(dt)  and  0  ^  U. 

In  our  case,  the  Levy  measure  for  the  counting  process  N  =  (Nt)t> 0  can  be  com¬ 
puted  as 

i/(£0  =  E[N(l,£0] 

=  E[E„<,<tl[AAf,6C/]] 

=  E[Ni  ■  l[jump  size  e  U]] 

=  E  [TV! ]  •  E[l[jump  size  G  U]] 

where  we  used  the  fact  that  the  time  instances  the  jumps  occur  are  independent  of  the 
jump  size.  To  compute  E  [TV]  ]  we  assume  that  Tp  <  1  which  is  always  the  case  in  real 
wireless  networks.  Then, 

E  [TV]]  =  7Tg\retPmac(l  ~  Tp ) 
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To  compute  E[l[jump  size  G  U]\,  recall  that  for  the  point  process  that  corresponds  to 
N  =  (Nt)t> o,  the  jumps  are  always  of  size  1.  Thus, 

E[l[jump  size  eU]]=P{leU}  =  S^U) 


where  Sx  is  the  Dirac  measure  at  x,  such  that  for  dcR 

1,  if  x  G  A 


4(A)  =  < 


0,  if  x  A 


Then, 


4^0  IT gXretPmac  '  (l  -^p)  '  4(^3) 


for  U  G  B(St)  and  0  £  U. 

Now,  we  can  rewrite  the  window  size  evolution  of  (3.1)  as 


Wt  —  Wo  +  /  /  q(Ws~,  a;  h)  N(ds,  da),  t>  0 

Jo  J[  0,oo) 

where 


q(w,  a;  h)  =  { 


a,  if  w  <  h  (slow- start) 

— ,  if  w  >  h  (congestion  avoidance) 


(3.9) 


3.5  Numerical  Approximation 


Because  of  the  analytical  intractability  of  the  optimal  stopping  problem  introduced 
in  Section  3.2  we  need  to  solve  the  problem  numerically.  Following  Kushner’s  Markov 
chain  approximation  method  [31],  we  proceed  by  discretizing  the  time  and  thus  moving 
from  the  original  optimal  stopping  problem  in  continuous  time  to  an  equivalent  problem 
in  discrete  time.  In  discrete  time,  the  evolution  of  the  system  is  described  by  a  Markov 
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chain,  with  transition  probabilities  that  can  be  computed  from  the  original  continuous 
time  dynamical  system.  We  then  formulate  an  optimal  stopping  time  problem  associated 
with  the  Markov  chain  and  solve  the  corresponding  dynamic  programming  equation  using 
the  value  iteration  method  [50]. 

3.5.1  Markov  Chain  Approximation 

The  discretization  of  the  time  is  based  on  the  transmission  time  Tp  of  a  packet.  In 
particular,  we  define  the  time  increment  5  to  be 


where  K  is  a  positive  integer.  For  larger  values  of  K,  a  smaller  increment  6  is  defined  and 
as  K  increases  to  infinity,  the  discretization  becomes  finer. 

The  stochastic  process  W  =  (Wt)t> o  that  describes  the  evolution  of  the  window 
size  takes  values  in  the  interval  [Wo ,  Wmax\.  When  TCP  operates  in  the  slow-start  regime, 
the  window  size  takes  values  in  the  set  of  positive  integers,  and  when  TCP  is  in  the  conges¬ 
tion  avoidance  phase  the  window  size  is  a  positive  real  number.  For  the  optimal  stopping 
problem  of  the  approximating  Markov  chain  the  window  size  does  not  need  to  be  dis¬ 
cretized.  We  only  need  to  differentiate  between  the  current  value  of  the  window  size  and 
the  value  that  the  window  size  will  take  after  a  new  acknowledgment  is  received  or  a  max¬ 
imum  waiting  time  is  reached.  Therefore,  we  do  not  discretize  the  interval  [Wo,  Wmax\ 
where  the  process  W  =  (Wt)t>o  takes  its  values. 

Suppose  at  time  t  —  t0  there  is  a  jump  to  Wto  =  w  for  the  original,  continuous 
time  system  (3.1)  and  the  slow-start  threshold  Ht  is  h.  We  define  the  Markov  chain  that 
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describes  the  evolution  of  the  system  given  that  at  time  t  =  to  the  size  of  the  window  is  w. 
We  want  to  solve  the  optimal  stopping  problem  for  the  Markov  chain  for  any  such  initial 
condition  (■ w,t0 ). 

The  approximating  Markov  chain  Xs’  h' to’  w  =  {X^  to -  w ,  n  —  0, 1, . . .  }  that  rep¬ 
resents  the  evolution  of  the  original,  continuous  time  dynamical  system  (3.1)  has  a  two 
dimensional  state  space: 

X6,  h' t0’  w  =  [Wo,  Wmax]  x  (to,  t0  +  S,t0  +  25,  ...,t0  +  ( K  +  M  +  1)  •  5}  (3.11) 

where  M  is  the  number  of  time  increments  that  we  allow  after  the  time  t0  +  K5  before 
we  declare  a  timeout.  Therefore,  the  parameter  M  defines  an  upper  bound  on  the  optimal 
stopping  time  of  our  problem  and  assures  that  the  algorithm  that  computes  this  stopping 
time  terminates. 

In  order  to  describe  the  transitions  of  the  Markov  chain  Xs ’  h’ to’  w ,  suppose  that 
the  chain  is  in  the  state  (w,  t0  +  i  ■  5).  For  i  =  0,1,2,...,  (K  —  1),  the  chain  can  only 
move  in  time  leaving  the  first  component  of  the  state  unchanged.  This  is  true  because 
in  the  original  continuous  time  dynamical  system  (3.1)  there  is  no  new  jump  for  a  time 
duration  equal  to  Tp  (the  transmission  time  of  a  packet)  after  a  jump  (which  we  assumed  it 
happened  at  time  t0).  Thus,  for  i  —  0, 1,  2, ... ,  (K  —  1)  the  state  that  follows  (w,  t0  +  i  ■  <5) 
can  only  be  (w,  t0  +  (i  +  1)  •  5)  and  this  transition  happens  with  probability  1. 

After  time  Tp  —  K  ■  S  has  elapsed  from  t0  a  new  jump  may  occur.  If  the  Markov 
chain  X5'  h:  to’  w  is  in  state  (w,  to  +  (K +j)  ■  5)  for  j  =  0, 1,  2, ... ,  (K  +  M—  1),  there  are 
two  different  events  that  may  happen,  and  thus  two  possible  transitions  out  of  this  state 
that  represent  these  events. 
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The  first  event  represents  a  new  jump  of  the  original  system  (3.1).  Thus  the  second 
component  of  the  state  will  increase  by  one  to  t0  +  (K  +  j  +  1)  •  S  and  the  first  component 
of  the  state  will  be  a  new  window  size  w' .  The  value  of  w'  depends  on  whether  TCP  is 
in  slow-start  (w  <  h )  or  congestion  avoidance  phase  (w  >  h ).  If  TCP  is  in  slow-start 
phase,  then  w'  —  w  +  1,  and  if  TCP  is  in  congestion  avoidance  phase  then  w'  =  w  +  K 
Such  a  transition  indicates  that  a  new  acknowledgment  has  arrived  at  the  TCP  sender 
which  implies  that  there  is  no  need  to  find  a  timeout  interval,  and  thus  solve  the  optimal 
stopping  problem.  The  transition  from  ( w ,  t0  +  (A'  +  j)  ■  5)  to  ( w t0  +  (A'  +  j  +  1)  •  5) 
happens  with  probability  pj  that  is  computed  from  the  p.d.f.  (2.7)  for  DMAC .  In  this  new 
state  the  only  transition  that  is  allowed  is  to  itself  with  probability  1. 

The  second  event  represents  the  fact  that  no  new  arrival  (and  thus  jump)  has  oc¬ 
curred.  In  this  case,  the  first  component  of  the  next  state  remains  the  same  and  equal 
to  w,  and  the  second  component  indicates  the  increase  in  time  by  the  increment  5.  The 
transition  from  (w,  t0  +  (A'  +  j)  ■  8)  to  (w,  t0  +  ( K  +  j  +  1)  •  <5)  happens  with  probability 
1  -  Pj- 

Finally,  if  the  Markov  chain  is  in  the  state  (vj.  to  +  ( K  +  M)  ■  5)  it  means  that 
the  maximum  allowed  waiting  period  has  been  reached,  therefore  a  timeout  has  to  be 
declared.  This  is  indicated  by  a  transition  to  (1,  t0  +  ( K  +  M  +  1)  ■  5)  with  probability  1. 

The  two  dimensional  Markov  chain  Xs’  h- 1,0 '  w  can  be  represented  schematically  as 
in  Fig.  3.1. 
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1 


1 


1 


1 


1 


1  Pm  —  l 


1—  Pm -2 


Figure  3.1:  The  Markov  chain  approximation  for  the  Optimal  Stopping  problem. 
3.5.2  Transition  Probabilities 


To  better  represent  the  Markov  chain  X5,  h ’  f°’  w,  we  name  each  of  the  two  dimen¬ 
sional  state  of  the  chain  as  follows: 

Si  =  (w,  t0  +  i  ■  d'j,  i  =  0, 1, 2, . . . ,  (K  +  M ) 

Fj  =  (w',t0  +  (K  +  j)  ■  5),  j  —  1,2, . . . ,  M  (3.12) 

R=  (l,to  +  {K  +  M  +  l)-8) 

Using  the  representation  of  (3.12)  the  Markov  chain  Xs’  h’  Uh  w  is  shown  in  Fig.  3.2.  The 
transition  probabilities  can  then  be  given  as 


•  for  i  —  0, 1,  2, ... ,  (K  —  1), 


Pr{Xsn+{  t0’  w  =  X  |  Xsn  h’ t °>  “ 


Si} 


1,  if  X  =  Si+1 

0,  otherwise 


(3.13) 
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Figure  3.2:  The  Markov  chain  approximation  for  the  Optimal  Stopping  problem  with 
different  state  representation. 

•  for  i  —  K ,  (AT  +  1), ,  (K  +  M  -  1), 


1  -pi-K,  if  X  =  S. 


i+ 1 


Pr{X5^{  t0'  w  =  X  |  Xsn  h ■ *0’  “  =  =  < 


Pi-K, 


0, 


if  X  =  F; 


i-K-\- 1 


(3.14) 


otherwise 


for  i  —  K  +  M, 


Pr{X5^{  * °’  “  =  X  |  X*’  t0’ 10  =  =  < 


1,  if  X  =  R 
0,  otherwise 


(3.15) 


for i  —  1,2 ,M, 


Pr{X^+{  t0’  w  =  X  |  X%  h' t0’  ™  =  Fi}  =  < 


1,  if  X  =  Fi 
0,  otherwise 


(3.16) 


51 


•  and, 


Pr{X , 


5,  h,  to,  w 


=  X  I  X: 


S,  h,  to,  W  _  TD\  _ 


=  R}  = 


1,  if  X  =  R 


0,  otherwise 


(3.17) 


The  cardinality  of  the  state  space  for  the  Markov  chain  X5,  h:  ,0-  w  is  K  +  2 M  +  2.  If  we 
order  the  states  in  the  following  manner: 


(<So,  ,  Sk+m ,  Pi,  P‘>,  ■  ■  ■ ,  Pm,  R^j 


(3.18) 


then  using  the  transition  probabilities  defined  above  we  can  write  the  (K  +  2 M  +  2)  x 
(K  +  2 M  +  2)  transition  matrix  0{,y'1  for  the  Markov  chain  Xs’  h' to ■  w  in  block  form: 


»Kx  1 


VRxM  ^ KxM  ^Kx  1 


q{5)  = 


®Mx  i  O mxk  Ijw  —  pm  pm  Omxi 


vlxK  ^1  xM  'U'lxM 


(3.19) 


vMxl  ^ MxK  ”MxM  ^Mxl 


hx/(  ^lxM  'U'lxM 


where  0.x.  is  the  zero  matrix,  I.  is  the  identity  matrix  and  PM  is  a  diagonal  matrix  with 
the  element  at  the  ith  diagonal  position  equal  to  p,  \ 


Pi  0 


0  0 


0  P2 


0  0 


pM  =  o  0  ...  Pi  ...  o  0 


(3.20) 


0  0 


0  •  •  •  pm- i  0 


0  0 


0  Pm 
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As  an  example,  for  K  =  2  and  M  =  3,  the  transition  matrix  ()(/>)  becomes: 


010  0  0  0  0000 

001  0  0  0  0000 

0  0  0  (1  -po)  0  0  po  0  0  0 

0  0  0  0  (1  -Pi)  o  0  Pi  0  0 

0  0  0  0  0  (l-p2)  0  0  p2  0 

000  0  0  0  0001 

000  0  0  0  1000 

000  0  0  0  0100 

000  0  0  0  0010 

000  0  0  0  0001 

3.5.2. 1  Computation  of  the  Transition  Probability  pi 

To  compute  the  transition  probabilities  Pi,i  =  0, 1, ... ,  (M  —  1)  we  use  the  results 
from  Chapter  2.  In  Chapter  2  the  random  variable  DMAC  represents  the  time  between  two 
successive  packet  transmissions  at  the  MAC  layer.  The  p.d.f.  of  DMAC  is  given  by  (2.7): 

fDMAc(t)  =  Pmac8(t  ~  Tp)  +  pmac(  1  -  Pmac)Kete~XretPmaC  ^~T^  U0(t  -  Tp)  (3.22) 

for  t  >  0. 

We  first  compute  the  probability: 

/OO 

fDMAc(t )  dt 

=  J  [Pmacd  (t  ~  Tp)  +  Pmac{  1  -  Pmac)  Arete_AretPmac'  U0(t  ~  Tp)  j  dt 
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0  <  s  <  T 


(1  ~Pmac)e  WW'(S  Tp\  S  >  T 


(3.23) 


For  i  =  0,1,2,...,  we  compute  the  probability  qjr”  6  =  Pr{Tp  +  (i  +  1)5  >  DMAC  > 
Tp  +  i5} 


Tp,  <5 

T 


'  Tv+i5 


ff)MAc(t )  dt 


=  < 


1  _  ( 1  _  (K)  ^  zd  ^ retPmacfi 

V-1-  Fmac )  °  ? 

_  P  AretPmac^^^  _  g  A retPmac 


Using  (3.23)  and  (3.24)  we  compute  the  probability: 


i  =  0 

i  =  1,2, ... 


(3.24) 


Pr  |tp  +  (i  +  1)5  >  DMAC  >Tp  +  iS  |  PMAC  >  Tp  +  itf} 


Pr(rp  +  (i  +  1)5  >  T>MAC  >  Tp  +  *5,  DMAC  >Tp  +  i5) 

Pr(pMAC  >  Tp  +  i5  j 


Pr ( Tp  +  (i  +  1)5  >  DMAC  >  Tp  +  i5) 
Pr(pMAC  >  Tp  +  i5) 


1  -  (1  -  pmac)e  AretP'm“c<5,  i  =  0 


=  < 


_  g  ^retPmac& 


*  =  1,2, ... 


(3.25) 


Using  (3.25)  and  taking  into  account  the  operation  of  the  wireless  channel,  we  can  com- 
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pute  the  transition  probability  pt : 


Pi  =  Tig-  Pr{  Tp  +  (i  +  1)5  >  DMAC  >Tp  +  iS  \  DMAC  >  Tp  +  i<f} 

TTg  ■  ^1  -  (1  -  Pmac)e~XretPrnacSSj  ,  *  =  0 

Tig  ■  ^1  —  e-XretpmacS^j  >  i  —  1,  2,  .  .  .  ,  (M  ~  1) 


(3.26) 


for  i  —  0, 1,  2, ... ,  (M  —  1),  where  ng  is  given  by  (2.4b): 

^bg 


Kg  = 


A bg  +  A  gb 


(3.27) 


3.5.3  Running  and  Final  Rewards 

The  running  reward  k(-;h )  is  defined  in  such  a  way  as  to  represent  our  unwilling¬ 
ness  to  declare  a  timeout  and  thus  minimize  the  window  size.  At  the  same  time  though 
this  unwillingness  should  be  decreasing  with  time,  since  as  time  increases  and  no  event 
has  occurred  (no  arrival  of  an  acknowledgment)  is  an  indication  of  bad  channel  quality. 
This  means  that  the  chances  of  finally  receiving  an  acknowledgment  become  smaller.  On 
the  other  hand,  if  we  have  already  built  a  large  window  size  we  might  be  reluctant  to 
declare  a  timeout  since  declaring  a  timeout  brings  the  window  size  to  its  minimum  value. 
Thus,  the  running  reward  k(-;h )  is  an  increasing  function  of  the  current  window  size  and 
a  decreasing  function  of  the  waiting  time. 

In  case  an  acknowledgment  has  arrived  and  the  Markov  chain  X5,  h' t(>'  w  has  moved 
to  an  Fi,  i  =  1,2, ...  ,M  state,  there  is  no  need  to  declare  a  timeout  and  thus  solve  the 
optimal  stopping  problem.  Because  of  this,  the  running  cost  is  0  for  these  states. 

If  no  acknowledgment  has  arrived  and  the  maximum  waiting  time  has  been  reached, 
the  Markov  chain  X5,  h- 1(1 '  w  will  move  to  state  R.  When  this  transition  happens  a  timeout 


55 


is  declared  anyway,  and  no  further  action  is  needed.  Hence,  the  running  reward  for  the  R 
state  is  0. 

More  precisely,  the  running  reward  is  given  by  (3.28) 

k(Si-,h)  =  -^—(K  +  M  +  l-i)aS,  i  —  0,1,2, ... ,  (K  +  M) 

**  max  '  ' 

k{Fi,h)=  0,  i  —  1,2, . . .  ,M  (3.28) 

k(R ;  h)  =  0 

where  a  is  a  parameter  that  depends  on  whether  the  TCP  sender  is  in  the  slow-start  (w  < 
h )  or  the  congestion  avoidance  phase  (w  >  h )  and  can  be  tuned  based  on  the  performance 
we  want  to  achieve  through  the  optimization  problem. 

The  final  reward  g(-;h )  also  depends  on  both  components  of  the  state  of  the  Markov 
chain  Xs’  h ’ to'  w.  For  the  states  Si,  i  =  0, 1,  2, ... ,  (. K  —  1),  the  final  reward  should  be 
0,  since  these  states  represent  waiting  time  during  transmission  of  a  packet  and  thus  no 
event  will  occur  with  probability  1.  For  the  rest  of  the  Si,  i  =  K,  (K  +  1), . . . ,  (K  +  M) 
states,  the  final  reward  is  defined  to  be  an  increasing  function  on  both  the  window  size 
and  the  waiting  time. 

If  an  acknowledgment  is  received,  and  thus  the  Markov  chain  X6,  h' moves  to 
an  Fi,  i  =  1,2, ... ,  M,  state,  the  final  reward  depends  on  the  new  window  size  which 
is  different  and  depends  on  whether  the  TCP  sender  is  in  the  slow-start  {w  <  h )  or  the 
congestion  avoidance  phase  (w  >  h ). 

Finally,  the  final  reward  for  the  state  R  depends  on  the  maximum  waiting  time  that 
we  allow  before  we  declare  a  timeout. 
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More  specifically,  the  final  reward  g(-',h)  is  given  by  (3.29) 


g(Si;  h)  =  0,  i  —  0,1, ,  ( K  -  1) 

g{Si-,h)  =  -^—ia,  i  =  K,(K  +  l),...,(K  +  M) 

vV  max 

(3.29) 

w' 

s(Fh  h)  =  — — (i  +  K)a,  i  =  l,2,...,  M 

Vv  max 

g(R;  h )  =  ( K  +  M  +  l)a 

where  a  is  as  in  the  case  of  the  running  reward  k(-). 


3.5.4  Optimal  Stopping  and  Dynamic  Programming 


The  optimal  stopping  problem  presented  in  Section  3.2  can  now  be  posed  on  the 
Markov  chain  X6,  h~ to '  If  Ns  is  a  stopping  time  for  the  approximating  chain  Xs ’  h’ to’  w, 
we  define  the  discounted  reward  according  to  (3.4)  to  be: 


J5’h(x,N5)=  E, 


'JV4-1 

S' 

.  n= 0 


■  k(X. 


5,  h,  to,  w. 


;h)-S  +  e~0  Ns  -g(X 


Ns 


3  h) 


(3.30) 


where  tsn  =  nd  and  (3  >  0  the  discount  factor.  If 


P5’  h(x )  =  sup  J6’  h(x,  Ns)  (3.31) 

Ns 

is  the  corresponding  value  function  for  the  problem,  it  satisfies  the  dynamic  programming 
equation: 


V5’  h(x)  =  max  jy^  e  0  sQ^s\x,  y)  ■  Vs’  h(y)  +  k(x)  ■  5,  g(x)^  (3.32) 

y 

For  numerical  purposes,  we  can  approximate  e~0S  in  (3.32)  with  [31]. 
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Because  of  the  discounting,  the  metric  J5,  h(x,  Ns)  in  (3.30)  is  finite  and  well  de¬ 
fined.  The  dynamic  programming  equation  (3.32)  is  also  well  defined  since  the  term 

SQ{5\x,  y )  •  V5,  h(y)  +  k(x)  ■  5  (3.33) 

y 

is  a  contraction  mapping. 

3.5.5  Simulation  Results 

To  solve  the  optimal  stopping  problem  for  the  approximating  Markov  chain  Xs’  h' t,:i' 
we  use  the  dynamic  programming  equation  (3.32).  Because  of  the  contraction  mapping 
property  of  (3.33)  we  use  a  combination  of  iteration  methods  in  both  the  value  and  the  pol¬ 
icy  space  to  get  the  solution  to  the  stopping  problem.  The  value  iteration  method  solves 
for  the  value  function  V5,  h  ( • )  and  the  policy  iteration  provides  the  optimal  stopping  set 
B  of  (3.6)  for  the  problem.  The  stopping  set  B  defines  practically  our  optimal  policy,  in 
the  sense  that,  whenever  the  Markov  chain  Xs ’  h’ w  moves  into  a  state  x  G  B  then  we 
stop. 

The  parameters  that  define  the  experiments  are  related  to  the  wireless  channel,  the 
MAC  and  the  TCP.  They  are  summarized  in  Table  3.1. 


Wireless  Channel 

MAC 

TCP 

Approximation 

by 

^ ret 

TP 

5,K 

^ gb 

Pmac 

P 

M 

a 

Table  3.1:  Simulation  parameters. 
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We  run  different  experiments  for  different  values  of  the  parameters  in  Table  3.1  and 
compare  against  the  standard  timeout  mechanism  of  TCP  [48].  The  channel  capacity  in 
all  experiments  is  2Mbps. 

In  Fig.  3.3  and  Fig.  3.4  we  compare  the  instantaneous  rate  when  using  the  timeouts 
that  are  solutions  to  the  optimal  stopping  time  against  the  standard  timeout  mechanism 
of  TCP.  In  the  case  of  Fig.  3.3,  the  mean  waiting  time  before  a  retransmission  at  the 
MAC  layer  is  O.lsec  (. \ret  =  10),  and  in  Fig.  3.4  the  corresponding  mean  waiting  time  is 
O.Olsec  ( Xret  =  100).  In  both  cases,  the  are  no  losses  at  the  wireless  channel  (ng  =  1). 
The  probability  of  a  successful  transmission  at  the  MAC  layer  is  pmac  =  0.3  and  the 
discount  parameter  f3  is  0.9.  Also,  in  both  cases  the  parameter  a  in  the  running  and 
final  rewards  is  1  when  TCP  is  in  slow-start  and  10  when  in  congestion  avoidance.  As  it 
can  be  seen  in  both  Fig.  3.3  and  Fig.  3.4  the  timeout  mechanism  that  is  produced  from 
the  numerical  approximation  to  the  stopping  problem  has  better  performance  than  the 
standard  implementation  of  the  timeout  mechanism. 

The  case  of  channel  losses  is  shown  in  Fig.  3.5  and  Fig.  3.6.  In  both  cases  the 
channel  loss  probability  is  n b  =  0.5.  Fig.  3.5  shows  the  case  where  the  mean  waiting 
time  after  a  collision  is  O.lsec  ( Xret  =  10),  and  Fig.  3.6  corresponds  to  the  case  where  the 
mean  waiting  time  after  a  collision  at  the  MAC  layer  is  O.Olsec  (A ret  =  100).  As  before, 
the  probability  pmac  of  not  having  a  collision  at  the  MAC  layer  is  0.3  for  both  cases.  The 
discount  parameter  (3  is  0.9,  and  the  parameter  a  in  the  running  and  final  rewards  is  1  for 
slow-start  and  10  for  congestion  avoidance. 

Finally,  In  Fig.  3.7  the  results  of  the  comparison  are  shown  where  the  discount 
factor  (3  is  0.001.  The  loss  probability  (1  —  ng)  at  the  wireless  channel  is  0.3,  and  the 
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Rate  without  channel  losses  (mean  MAC  ret.  O.lsec) 


Figure  3.3:  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and  the 
TCP  mechanism  in  the  absence  of  losses  at  the  channel  and  mean  retransmission  waiting 
time  O.lsec  at  the  MAC  layer. 

mean  waiting  time  before  retransmission  at  the  MAC  layer  is  O.Olsec  (A ret  =  100). 
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Rate  without  channel  losses  (mean  MAC  ret.  O.Olsec) 


Figure  3.4:  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and  the 
TCP  mechanism  in  the  absence  of  losses  at  the  channel  and  mean  retransmission  waiting 
time  O.Olsec  at  the  MAC  layer. 
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Rate  with  channel  loss  prob.  0.5  (mean  MAC  ret.  0 . lsec) 


Figure  3.5:  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and  the 
TCP  mechanism  with  a  loss  prob.  0.5  at  the  channel  and  mean  retransmission  waiting 
time  O.lsec  at  the  MAC  layer. 
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Rate  with  channel  loss  prob.  0.5  (mean  MAC  ret.  O.Olsec) 


Figure  3.6:  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and  the 
TCP  mechanism  with  a  loss  prob.  0.5  at  the  channel  and  mean  retransmission  waiting 
time  O.Olsec  at  the  MAC  layer. 
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Rate  with  channel  loss  prob.  0.3  (mean  MAC  ret.  O.Olsec) 


Figure  3.7:  Comparison  of  the  instantaneous  rate  between  the  stopping  problem  and  the 
TCP  mechanism  with  a  loss  prob.  0.3  at  the  channel,  mean  retransmission  waiting  time 
O.Olsec  at  the  MAC  layer  and  discount  factor  (5  =  0.001. 
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Chapter  4 


Conclusions 

The  focus  of  this  thesis  is  the  flow  control  in  wireless  networks  and  specifically 
the  behavior  of  the  Transmission  Control  Protocol  (TCP)  in  conjunction  with  a  random 
access  MAC  protocol.  The  current  work  investigates  issues  that  are  not  usually  dealt  with 
in  the  research  literature,  namely  the  dynamical  behavior  of  TCP  and  more  specifically 
the  evolution  of  its  window  size  and  also  the  effect  of  the  slow- start  phase  and  the  related 
mechanism  of  timeouts  to  the  TCP  throughput. 

The  general  approach  that  is  followed  is  based  on  the  idea  that  taking  advantage  of 
the  dependency  among  quantities  that  characterize  different  layers  of  the  protocol  stack, 
can  improve  the  performance  of  the  network.  At  the  same  time,  we  constrain  ourselves 
to  a  minimum  number  of  changes  to  the  standard  TCP  operation.  We  do  that  in  order  to 
achieve  interoperability  between  our  solution  and  the  standard  TCP  protocol. 

4.1  TCP  and  Aloha 

In  Chapter  2  we  have  developed  a  stochastic  differential  equation  that  describes  the 
evolution  of  the  TCP  window  size  with  time.  The  random  access  MAC  is  the  pure  Aloha 
and  the  behavior  of  the  channel  is  modeled  through  a  two  state  Markov  chain  according 
to  the  Gilbert-Elliott  model. 

The  equation  is  driven  by  a  point  process  that  represents  the  arrival  of  acknowledg- 
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ments  to  the  sender.  We  take  into  consideration  the  packet  length  and  the  finite  capacity 
of  the  channel.  This  introduces  for  each  point  of  the  process,  a  time  interval  which  is 
constant  and  during  which  no  event  occurs  with  probability  1 .  Because  of  this,  the  point 
process  is  not  a  Poisson  process. 

We  fully  characterize  the  point  process  by  first  computing  the  statistics  of  the  inter¬ 
arrival  intervals  and  then  computing  its  compensator  and  the  corresponding  intensity. 

Finally  we  compare  our  analytical  model  against  simulations  for  different  values  of 
the  parameters  that  characterize  the  channel  and  the  Aloha  protocol.  We  see  that  although 
our  analysis  is  based  on  certain  assumptions,  our  model  is  valid  and  closely  matches  the 
simulation  results. 

4.2  Timeout  Mechanism 

Chapter  3  builds  on  the  results  of  Chapter  2  and  uses  the  dynamics  of  the  window 
size  to  properly  tune  the  timeout  mechanism  of  TCP  in  order  to  increase  the  throughput. 

We  pose  the  problem  as  an  optimal  stopping  problem  with  the  stochastic  differen¬ 
tial  equation  of  Chapter  2  as  a  constraint.  The  fact  that  the  driving  point  process  is  not  a 
Poisson  process  makes  the  analysis  intractable.  Motivated  by  the  approximation  method 
of  Kushner  for  stochastic  control  problems  in  continuous  time,  we  develop  a  numerical 
approximation  to  the  original  problem.  Using  dynamic  programming  we  solve  the  dis¬ 
crete  time  version  of  the  original  problem  and  retrieve  stopping  policies  that  define  the 
new  timeout  mechanism.  We  verify  the  performance  increase  by  comparing  our  solution 
to  the  standard  TCP  timeout  mechanism  using  simulation  and  for  different  values  of  the 
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involved  parameters. 
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Appendix  A 


Appendix  to  Chapter  2 

This  appendix  provides  proofs  to  intermediate  results  needed  in  Chapter  2. 


A.  1  Physical  Layer 

To  compute  the  probability  po(t)  the  chain  is  in  the  “bad”  state  at  time  t  we  formu¬ 
late  a  differential  equation  in  po(t)  which  we  solve.  For  any  time  t  >  0  and  h  >  0  small 
enough: 

Po(t  +  h)  =  Po(t)poo(h)  +  pi{t)pw{h) 

=  p0(t)  [1  -  A bg  +  o(h)\  +  Pi(t)  [1  -  A gb  +  o(h)\  =>■ 

P0 ^  +  ^ =  -AfegPo(t)  +  \gbPl{t)  +  °^~  (poit)  +Pl(t)) 

Letting  h  {  0  and  using  p0(t)  +  p\{t)  =  1  for  all  t  >  0,  we  have: 

^Po(t)  =  -(A hg  +  Xgb)p0(t)  +  Xgb ,  for  t  >  0 

The  solution  to  this  differential  equation  is: 


Po(t) 


A 


gb 


Xbg  +  A 


gb 


^ gb  \ 

A  bg  +  XgbJ 


^  —  (^bg  +  ^gb)t 


for  t  >  0  and  some  initial  probabilities  po(0)  and  j>\  (0 )  for  the  chain  to  be  in  the  “bad” 
and  the  “good”  state  respectively,  at  time  t  —  0. 
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To  compute  the  time  the  chain  spends  in  each  state  i  E  V,  we  define  the  random 


variable  T%  as  the  waiting  time  of  Pt  in  state  i  E  V  given  the  process  is  in  state  i.  If 
P{Ti  >  t}  —  Gi(t )  and  h  >  0  small  enough,  then  for  t  >  0, 

Gi(t  -T  K)  =  P {Ti  >  t  +  h} 

=  P{P  >  t}P{Ti  >  h} 

=  Gi(t )  ( pu(h )  +  o(/t)) 

=  Gj(f)  (1  -  Vih)  +  o(h)  ==> 


Gj(f  +  h)  —  Gi(t) 
h 


-v.iGiit) 


where 


By  letting  h  [  0,  we  get 


I  \bg ,  if  i  =  0 

I  A gb,  if  i  =  1 


d 

dt 


Gi{t) 


—VjGj{t),  fort>0 


Setting  Gi(0)  =  1,  we  get 


Gi(t)  =  e~Vit,  t  >  0 


That  means,  the  waiting  time  in  each  state  is  exponentially  distributed  and  more  specifi¬ 
cally, 


P{T0  >t}  =  e~Xb°\  t  >  0 
P{Ti  >t}  =  e~x°bt,  t  >  0 
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A.2  MAC  Layer 


We  first  compute  the  characteristic  function  of  the  random  variable  Ylf=i  X )  in 
Section  2.3.2. 

r  i  +°°  r  i 

P{K  =  k) 
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II 
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+0O  /  ,  \  k 

^ ret 
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A rpt  —  is 


k= 0 

A  ret  ^ S 


(1  Pmac )  Pr, 


~Pr 


A retPmac  is 

where  we  used  the  fact  that  the  random  variable  K  is  geometrically  distributed  with  p.m.f. 


P{K  =  &}  =  (!-  Pmac)kPmac,  k  =  0,  1,  2,  . 


The  characteristic  function  of  the  random  variable  IJMAC  =  Tp  +  Ylf=i  Xj  can  then  be 
computed: 


JsDmac 


=  E 

=  E 


,i*(rP+£jL  ixj 


gisTp  #  Xj 


eisTp  E 


eis  X3 


Xret  'i'S 


XretPmac 
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XretPmac  is 
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A.3  Negative  Binomial  Distribution 


Let  A'i,  K2,  . . . ,  Kn  be  geometrically  distributed  i.i.d.  random  variables  with  pa¬ 
rameter  prnac,  SUCll  that 

P{I<i  =  k}  =  Pmac  ( 1  -  Pmac)k,  k  =  0,1,2,... 

for  i  =  1,2, ...  ,n.  The  characteristic  function  for  K,  is  E [ els K'  1  =  ,  Pmac  .  for 
i  —  1,  2, . . . ,  n. 

If  K  =  YTj=i  P  j  ’  bicn  the  characteristic  function  of  the  random  variable  K  can 
easily  be  shown  to  be 

p  \pisK]  _  ( _ Pmac _ \ 

L  J  [l  -  (1  -  pmac)e™  ) 

which  corresponds  to  the  negative  binomial  distribution  with  parameters  n,  pmac  and 
p.m.f. 

P{K  =  k}=  f”  +  kk  ~  ^^(1  -  Pmac)\  k  =  0, 1, 2, . . . 

A.4  Thinning 

If  D  is  the  generic  random  variable  representing  the  interarrival  time  between  points 
in  the  thinned  point  process  at  the  physical  layer,  then 

I< 

d  =  Y l  DjIAC 

3= 1 

where  K  is  geometrically  distributed  with  pmf, 

P{K  =  k}  =  ng(l-ng)k-1,  k  =  1,2,... 
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Using  the  same  methodology  as  in  Appendix  A. 2,  the  characteristic  function  of  D  can  be 
computed. 


E  [eisD]  =  E  [eis  DfA°] 

+OO 

=  ^E[e*sE!=i  D^AC  |  K  =  k]P{K  =  k} 

k=  1 

+°o  , 

=  E(EUD“1)  ».d  -*.ri 

k=  1 

7T9E[e^MAC] 

”  1  -  (1  -  7Tg)E[eisDMAC' 


72 


Appendix  B 


Appendix  to  Chapter  3 

This  appendix  provides  proofs  to  intermediate  results  needed  in  Chapter  3. 


B.l  Computation  of  E  Yl?j=i  Xj 


From  (2.10)  of  Chapter  2  we  have  that 


0(s)  =  E  eis^?='xi 
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rmac  /  j 
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where  S(n,p)  =  ELo  ©fc  (^c 
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